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INTRODUCrnON 


This volume is the account of hnw a number of psycholofTistfi aiul psychia- 
trists attempted to assess the merits of men and women rccruiicd for ll\c 
Office of Strategic Services, The undertaking is re[iorted because it represents 
the first attempt in America to design and carry out scdectinn prf>ceclures in 
conformity with so-called orguntsmic (Cic stall) [)rinclples. As a novel experi- 
ment it might interest a wide range of I'caders, but tnorc .s[)ecifical[y we 
it will invite the attcntkai cif those who are conccrticcl with the prohlem f>[ 
predicting human l)ehavior, especially if ihey are engaged in practicing and 
developing clinical psychology and psychiatry and in im[)rTwiiig present 
methods of diagnosis, assessment, and sclcctiotu 
All told, 5,3(ji recruits were studied intensively over a ihrcc-day period at 
one station or over a one-day period at atu^ther, 'I’liesc \verc the two areas 
in the United States where the hulk of assessment was deme. Of these the 
performancCvS of 1,187 who went overseas were tleserihetl and rated hy their 
superior officers and associates in tlic theater. 

Some staiularcl pia)cedurc,s, clcineiUalisiic in design, were inchuicrl in iiur 
program, because the best of these instruments are e.s[t(;eially effinJcnt in pick- 
ing out disqualifying defects tffi function and so in eliminating men who arc 
definitely inferior. Organismic nictliods, on the other hand, arc to he recom- 
mended in addition whenever it Is necessary to discriminate unusual talenr, 
to measure ability In the range running from low average to high superitir. 

The plan described in this hook was devised to lit the S[xa*ial needs of the 
Office of Strategic Services, but it would not take niucb ingenuity to mtulify 
some of the tcchnkpcs and to invent others of the same ty[>e to meet the re- 
quirements of other institutions. 

These methods were first used on a large scale hy Simoneit, as described 
in Wehr psychologic t and the German military [)sychologists, and after them 
by the British. Our particular debt is to the hand of imaginative and progres- 
sive psychiatrists and psychologists wh<i devised and conducted the War 
Office Selection Board (WOSB) [)rt>gram for testing officer candidates for 
the British Army. hVom them we gained the valuable itica of having stall and 
candidates live together in the cuuiury during the testing period, and the 
conception of Icaderless group situations, 

Several months of statistical calculation on the part of more than a dozen 
psychologists and psychiatrists, working with the International Business 
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4 Assessment of Men 

Machines, went into the making of this book, but at the end the time availa- 
ble for reflection and critical analysis was not enough to pci mlt the fruits of 
our exertions to ripen fully. Since we did not intend to write a textbook, no 
attempt has been made to cover the literature or to refer to the numerous re- 
searches which contributed to the construction of our program of procedures, 
The layman will not find the language of this book difficult. In all but a 
few sections, technical terminology was avoidable. 

How did this program of assessment come about? As the following pages 
will reveal, it embodied many conceptions. It was the work directly and 
indirectly of many hands and brains. The formal opening of the program 
came about as a result of a genuine need. By late 1943, OSS, then hardly " 
a year old, was busily and somewhat hazardously recruiting personnel 
without benefit of any professional or uniform screening process. Then 
came the exciting stimulus: the suggestion by an official from OSS in 
London who had recently visited a WOSB unit in Britain that a 
psychological-psychiatric assessment unit be established in the United States, 
This idea was presented in October, 1943, at one of the morning executive 
staff meetings of General William J. Donovan, head of OSS. It was well 
received by those of the recruiting branch who were present and especially 
by Cols. John A. Hoag and Henson L. Robinson of the Schools and Train- 
ing Branch, whose training programs had carried the brunt of too many 
cases of bad recruitment. Impressed also was the only psychologist present, 
Dr. Robert C. Tryon, Deputy Chief, Planning Staff, who saw at once a 
real opportunity for his fellow psychologists to contribute. He recommended’ 
that the Schools and Training Branch and the Planning Staff collaborate 
in setting up an assessment program. 

During the following month of November Colonel Robinson and his 
staff set to work to procure the facilities which would be required, In the 
Planning Staff, Dr. (later Capt.) James A. Hamilton, Dr. (later ist Lt.) 
John W. Gardner, and Dr. Joseph A. Gengerelli rapidly sketched out in a 
general way the principles and methods that were to characterize the new 
program. 

These hurried preparations culminated in a final two-day conference oi 
all these men from the two branches and also Dr. (later Lt. Col.) Henry 
A. Murray and Dr. Donald K. Adams who had been invited as consultanu 
in working out the details of the program. This was a stimulating session, 
held at “The Farm,” a secluded intelligence briefing area. Shortly thereafter 
the director of OSS issued the order authorizing the establishment of the 
assessment unit and within fifteen days a task force of six psychologists 
and psychiatrists greeted the first group of bewildered asscssccs. Three ol 
the task force Dr, John W. Gardner, Dr. Joseph A. Gengerelli, and Dr 
James A. Hamilton — -were old OSS hands by this time; three were new- 
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ners-Dr. Donald K. Adams, Lt, Donald W. Tiskc (USNR), and Dr. 
;nry A. Murray. 

The aflair got under way very rapidly in a gale of resourceful activity 
d good will, largely due to the contagious v.cst of our administrator, 
r. Hamilten. 

The locus of the undertaking was a country estate forty minutes fjutsidc 
'ashington, a farm with rolling niciulowland and self-respecting shade trees, 
assive barn and satellite shecls and kennels, which [irovirled am[>k space 
r setting up all sorts of stressful situations, indoors and outdoors, to test 
e intelligence and stamina of the candidates. This was kiujwn as ‘"Station 
or “S School" (since it l>clongcd to the Schools atul Training Branch), 
simply "S.” "S" was synonymous with Secret. 

The candidates, it was arranged, would conic in groups, nr “classes,'’ 
eh group niimhcring about eighteen men. The duration of each testing 
riod was three days. 

Within a month the sniff was strengthened by the arrival of Dr. Rgerton 
Ballachcy, Dr. Richard S. Lyman, and Dr. Donald W* MacKiiinmi, and 
ter by a hast of others, for longer or shorter periods, many ctf thrtn special- 
:s of one sort or another, such as Dr. Janet Rit>t:h, Dr. Ldward C, Tolman, 
r. Theodore M, Newctjmh, and Dr. Daviil M. I.evy. 

During the late winter of the torrent of candidaics at .Station S hreame 
I great that it was decided to set up Station W in Washingtcui in order xo 
ke care of the overflow, with a .staff c()m[Ki,sc(l cif Ckptain Hamiltmu Dr. 
dams, Dr, Ballachcy, M/Sgr. David Krecli, and Dr, Rioch. Theirs was a 
le-day program of assessment. Two months afterwards, Station W$, [o- 
itcd on a Pacific beach, was assessing candidates recruited in the West, And 
icn, in the midst of these dcveln[imcnrs, a request arrived frtnti the Far 
ast for specialists to screen native agents. In answer to this call, Dr, Lyman, 
If. Lucien M. Hanks, and C'apuiin ITamilton sc't out for Ckylnn, trj hr .sue* 
:edcd six months later liy Dr. Ballachcy and Mr. Bradford B. Hudson, 
inally, in the spring of lo.}^, Dr. Bingham Dai, Mr. Hudson, Dr. Lyman, 
lid Colonel Murray, with the assistance of six able Cdiinese psychologists, 
ssessed some Son C.hincsc recruits for the parruroop commando units that 
'ere in training at Kunming, Yunnan Prcwincc. A fortnight before V-J day, 
fr. Hudson, who had previously directed a sluu tdived assessment unit near 
lalcutta, went far north to Hsian to assess a special group of Korean agents, 
To take care of the iiiia.sscsscd personnel vvln^ in the fall rd were being 
ipidly transferred from Prance via Wa.shingtnn to the luir Phist, a reassess' 
lent unit was inaugurated by Ck^lonel Murray, Dr. G. Cnlket C'aner, and 
!apt. James G. Miller at Area F. The direction of this undertaking cventu- 
lly became the responsibility of Captain John A. Kneipp, who had adminis- 
tred Station WS after the departure of Lieutenant John W. Gardner. 

For the last year of its history the director of Station S was Dr. MacKinnon. 
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The comparable position at W during this period was held successively by 
Dr. Adams, Dr. Ballachey, Dr. Dwight W. Chapman, and Cx>mniander 
Robert A. Cohen. 

For most of those engaged in this undertaking the whole experience was 
an exceedingly happy and rewarding one. Besides the essential feeling that 
we were forwarding the success of OSS activities and in this way contribut- 
ing to the defeat of Fascism, there were countless satisfactions to he denved 
from working as members of a congenial, stimulating, dedicated grfHi[). 

Particularly gratifying was the proof that psychiatrists and psychfdogists 
(men of science drawn from universities) could work harmoniously luid 
fruitfully with businessmen and professional soldiers (men of action clr«iwn 
from the world of affairs). No college president or faculty, wc sup[X)SC, ever 
gave any psychological endeavor the backing and encouragement that was 
given our assessment units by the administrators of OSS, by such men as 
General William J. Donovan, Col. G. Edward Buxton, Mr. Charles S, 
Cheston, Mr. John O’Gara, Mr, Whitney ?L Shepardson, Dr. William L. 
Langer, Col. J. Russell Forgan, Mr. James R. Murphy, and Col. Richard P, 
Heppner. Dr. James L. McConaughy and Colonel Robinson and the staff of 
the Schools and Training Branch were especially staunch in our support. 
Dr. Edward L. Barnhart, psychologist in the Presentation Branch, was of 
great assistance in the planning and production of tests and other materials, 
To them, as well as to many others, we are grateful for making possible a 
high degree of coordination between the activities of the assessment staff 
and those of other branches. Our experience encourages the hrtpc that 
collaborations of a similar sort between social and medical scienList.s and 
government officials will, with mutual benefit, be even more clTective in 
peacetime. 

Last to be mentioned but first in the magnitude of their contribution to 
our project were the thousands of candidates, most of whom, to our astonish- 
ment, were able unresentfully to tolerate the indignities and ordeals tliat we 
invented for them. We wish to thank them once more not only for [)aruci- 
patlng fully in the whole program but especially for bringing to our home- 
stead at Station S so great a diversity of interests and talents. To this diversity 
may be attributed the extraordinary fact that in twenty months not a single 
member of the staff complained of boredom. It was as if we were the recluse 
who had invented the new mousetrap. For the whole world, men and women 
of all nationalities and temperaments, seemed to be intent on beating a path 
to our retreats. 

We hope that we shall meet and recognize many of these thrcc-clay friends 
of ours in years to come. In any event, we shall be ever on the lookfjut for 
news of them, especially of those for whom we predicted notable successes ^ 
this man to become Senator from Arizona, this one to edit a news[)aper 
which would make Centreville more famous than Emporia, that tall young 
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man to penetrate the mystery of mysteries of enzyme action* this fellow to 
complete his authoritative treatise on C'hincsc philosophy, that other one to 
play an imptn’tant role in attaining the final acceptance of a worhl govern- 
ment, and the stocky one with reel hair to find the summit of contentment 
with his wife and children on a dairy farm in Marylaiidj to mention hm a 
few. We trust that these will not fail lo make paths for their pfiteiuialiiies so 
that our preilictious will be verified and there will he triumphs in which we 
can partake vicariously as we say to ourselves: "Ahj years ago this was 
foreseen/’ 



Chapter I 

THE NATURE OF THE TASK 


The task confronting the OSS assessment staff was tliat of developing 
a system of procedures which would reveal the personalities of OSS recruits 
to the extent of providing ground for sufficiently reliable predictions of their 
usefulness to the organization during the remaining years of the war. 
In this sentence everything hangs on the meaning of “sufficiently reliable 
predictions." 

It is easy to predict precisely the outcome of the meeting of one known 
chemical with another known chemical in an immaculate test tube. But 
where is the chemist who can predict what will happen to a known chemical 
if it meets an unknown chemical in an unknown vessel? And even if all 
the properdes of all the chemicals resident in a given laboratory are exactly 
defined, is there a chemist who can predict every chemical engagement that 
will take place if Chance, the blind technician, is in charge of the proceed- 
ings? Can a physician, steeped though he may be in the science of his pro- 
fession, say for certain whether or not the body he has just examined will 
contract contagious jaundice next summer in Algiers? How, then, can a 
psychologist foretell with any degree of accuracy the outcomes of future 
meetings of one barely known personality with hundreds of other un- 
dcsignated personalities in distant undesignated cities, villages, fields, and 
jungles that are seething with one knows not what potential harms and 
benefits? Fortune— call the old hag or beauty what you will— can never 
be eliminated from the universe of human interactions. And this being 
forever true, prophetic infallibility is beyond the reach of social scientists. 

Furthermore, we would guess that no matter how substantial are the 
advances of scientific psychology, the best series of predictions of indmtJual 
careers-apperception operating as it does-will involve the play of experi- 
enced intuitions, the clinical hunch, products of unconsciously perceived and 
integrated symptomatic signs. The assessment of men-wc trust that Samuel 
Butler would agree— is the scientific art of arriving at sufficient conclusions 
rrom insufficient data. 


• who are trained in assessment, we hope, arc "suffi- 

ciently reliable predictions,” or "sufficient conclusions," that is to say, predlc- 
tions or conclusions which will serve, by the elimination of some and the 
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better placement of otherS) to decrcusc the ultimate failures or unsatisfactory 
performersj by such a number that (i) the amount saved plus (it) the 
amount of harm prevented plus (iil) the amount gained is greater than the 
cost of the assessment program* The amount saved can be roughly computed 
in terms of the average expenditure of money and time (spent by other 
members of the organization) in training, transporting, housing, and deal- 
ing with an individual who in the end proves to be incapable iiischnrging 
his duties properly. The most important item, the amount of harm 
vented, is scarcely calculable. It consists of the friction, the impairment of 
efficiency and morale, the injury to the reputation of an organizaciori that 
results from the actions of a man wlio is stupid, apathetic, sullen, resentful, 
arrogant, or insulting in his dealings with members of his own unit or of 
allied units, or with customers or citizens of foreign countries. To this 
must be added the irreparable damage that can he done by one who blabs 
Diminution in the number of men of this stamp— sloths, irritants, had actors, 
and free talkers— was one of the prime objects of the assessment I'lrcigram, 
The amount gained is equally hard to estimate. It consists of the average 
difference bctvvcen the positive accomplishments of a failure and of a success, 
An unsatisfactory man, by fdling an assignment, dc[irives the organization 
of the services of a man who might he capable (ff a .substantial amtrilnu 
tion. Some OSS schemes, in fact, were entirely abandoned because in each 
case the man who arrived in the theater to undertake the [project was Etumti 
to be unsuitable. Thus every pronounced failure costs the organization a 
good deal of time and money, lowers the efficiency and reputation of tme rif 
its units, and, by taking the. place of a competent man, prevents the attain- 
ment of certain goals. 

Needless to say, no OSS official was urged to weigh these subtleties and 
come out with an answer in dollars and cents. For even if it had been 
possible to make such an estimate, no use could have been made of it, 
since the one figure that was needed for an evaluation of the assessment pro- 
gram was not obtainable: the percentage of failures among the thousands 
of unassessed men and women who had been recruited prior to December, 
1943. The available records were not accurate or complete enough to give 
the staff at Station S this level against which to measure its results, and so 
at the outset we had to face the fact that we would never know certainly 
whether we had been an asset or a liability to the OSS* 

The chief over-all purpose of the OSS assessment staff—to eliminate 
the unfit— was similar to tliat of the conventional screening board, but in 
certain other respects the task of the former was unique: i\\t number and 
nature of the billets to be filled by “bodies,'' the adequacy of the information 
about the different assignments, the types of men who came to be assessed, 
the conditions under which the work was done, the kinds of reports that 
were required, and so forth. A full description of these differences should 
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constitute the best possible definition of the task undertaken by the psy- 
chologists and the psychiatrists of the OSS. 

The Office of Strategic Services was a wartime agency set up by the 
President and Congress to meet special conditions of World War IL It was 
the first of its kind in the history of the United States. Its functions were 
varied. On the one hand its purpose was to set up research units in the 
United States and overseas as well as an elaborate network of agents to 
gather strategic information concerning the activities and vulnerabilities of 
the nation’s enemies, to analyze and evaluate this information, and to report 
it to those concerned. On the other hand, its object was to conduct a multh 
plicity of destructive operations behind enemy lines, to aid and train resistance 
groups, and, by radio, pamphlets, and other means, to disintegrate the 
morale of enemy troops and encourage the forces of the underground* 

To carry out these functions it was necessary that hundreds of special 
skills outside the sphere of civilian experience be learned rapidly by thou- 
sands of Americans, many of whom did not feel like figluing. And these 
novel skills, taught by men who had mastered them but recently, had to 
be put into practice in some of the most inaccessible, least known, and 
outlandish parts of this broad earth. And here is where General Donovan 
came in. 

General Donovan himself was a mobile unit of the first magnitude. 
Space was no barrier to him— the Sahara Desert was a little stretch of 
sand, the Himalayas were a bank of snow, the Pacific was a mere ditch. 
And, what is more. Time was no problem, Circling the globe, according 
to good evidence, he would catch up with Time and pass it* No one was at 
all surprised if he left one morning and returned the previous afternoon. 

The Generars triumph over the two fundamental dimensions of our 
universe is certainly the leading reason why OSS men, seen or unseen, 
were operating on most of the strategic surfaces of the earth. 

But more elementary than this— for one has to explain why he was in- 
clined to fly about the way he did — was General Donovan’s {xnver to 
visualize an oak when he saw an acorn. For him the day was never suffi- 
cient unto itself: it was always teeming with the seeds of a boundless 
future. Like Nature, he was prodigal, uncontainablc, forclooking, and every 
completed project bred a host of new ones. His imagination shot ahead, 
outflying days and distances, and where his imagination went, there would 
his body go soon afterward, and at every stop, brief as it might be, he 
would leave a litter of young schemes to be reared and fashioned hy his 
lieutenants and transmuted finally into deeds of daring. This is the key 
to the problem. It explains why OSS undertook and carried out more differ- 
ent types of enterprises calling for more varied skills than any other 
single organization of its size in the history of our country. 

Now it is not for us to say to what extent these far-flung undertakings 
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were successfuk Our purpose here is merely to call attention to the sit' 
nation that deserves first place on the list of conditions which differen- 
tiated our endeavor from those of most other selections and placement 
agencies : 

Variety and Novelty of OSS runctions; Variety and Remotene^ of 
the Situations. — Among the various consequences of this combination of 
factors, the following deserve mention: 

i) It was many months before our conceptions of the clifTcrcnt jobs were 
more than half accurate. We were given the briefest possible time in which 
to prepare. No one arranged a preliminary world tour for the staff so that 
the conditions at each base and the operations in progress could be observed 
at first hand. The information that came in from the theaters was scanty; 
and even if it had been ample and adapted to our purpose, there would 
have been too much to learn in the time available, too much to remember. 
Not until much later did some of us who visited installations in the. field 
come to realise the magnitude of the discrepancy between even the better 
job descriptions— those received in the later months — and the various 
dispositions and skills that were actually required in tlic field, 

ii) It was not possible to arrange a unified thrcc«day program, much less 
a onc'day program, which would test so great a variety of functions. It 
would have been a comparable situation, for example, if a d07.cn educators 
were asked to set up a school with a six month term for the training c^f 
farmers, machine workers, salesmen, stockholders, explorers, chemists, 
diplomats, physicians, philosophers, congressmen, and theologians. 

iii) Many of the jobs proposed for candidates were different from any- 
thing they liad ever done before, and so the staff could not rely on the work 
histories of these men ns evidence of ability or aptitude, 

iv) Many foreigners and first-generation Americans were recruited be- 
cause they were familiar with the language, people, and territory of their 
respective lands of origin. It was difficult for a staff of Americans to judge 
men from cultures so diverse and to predict how well they would succeed 
in dealing with their own countrymen, 

Lee us now consider these points in more detail, and subsequently a few 
other points. 


Lack of Adequate Job Descriptions.^-The task assigned to us was to 
decide in each case whether the candidate was fit or could be made fit for 
the job designated on the Student Information Sheet which accompanied 
him. Here and elsewhere the term job (or assignment, mission, task) is used 
to designate (i) a certain set of functions constituting a rale fulfilled in (ii) 
an environment composed of a certain set of situations that prevail in a given 
theater. Thus job includes both the role (with its functions) and the en^ 
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vironment (with its situations). Therefore the first thing that the members of 
the staff should have done was to familiarize themselves with the situations 
that were likely to be encountered in all the theaters of operation as well 
as with all the functions that men would be expected to perform there. 
But since this, as we have said, was not possible at the start, it was neces^ 
sary to compare the candidate with an abstract idea, or with images that 
were indefinite or incorrect. The knowledge that many of the candidates 
were to play parts in unbelievable dramas thousands of miles away served 
to cast a veil of enchanting irreality over the whole endeavor. 

No member of the assessment staff possessed intimate knowledge of 
more than a small fraction of OSS activities. All of us had a fairly clear 
idea of the functions of a secretary, an office clerk, an admini.strator, a 
medical technician, a historian engaged in analyzing the economic, political, 
and social structure of this or that country. But less definite certainly 
was our knowledge of the qualifications for the job of script writer, base 
station operator, demolitions instructor, field representative, section leader, 
And hazier still were our notions of the typical operations of a paratrooper, 
resistance group leader, saboteur, undercover agent, liaison pilot, pigcoacer. 

One member of the staff, Dr. Lyman, had lived in China, and several 
had traveled extensively in prewar Europe, but none had worked in London 
during the blitz or had been under shellfire in Italy. Specific information 
about present conditions was lacking. What was the strength of die rc>sis- 
tance groups in France? Was it necessary for an agent to look and speak 
like a native? What special problems confronted an operator in Yugo- 
slavia or Greece? Was a tendency to alcoholism facilitated in Calcutta? How 
potent were the demoralizing effects of malaria in Burma? Were the 
Kachins difficult to work with? What were the living conditions in Kandy? 
Could we assume that most of the Chinese would be cooperative? No doubt 
the answers to some of these questions might have been found in books 
which none of us had time to read. But where could we have learned 
about the very special activities of OSS men in the field? Many of the 
operations were still in the planning phase; others were being carried out 
behind enemy lines outside the range of witnesses, and even at the most 
advanced bases the officer in charge was often for long periods uncertain 
as to what his men were doing out there in the unknown. It was some- 
times months before enough knowledge was accumulated to form the basis 
of a report that could be hurried back through channels to the United 
States. Rarely were the details in any series of reports sufficient to give the 
officers in Washington vivid concrete pictures of the real circumstances 
in this or that OSS installation overseas, We realized, for example, that the 
performances of many men would vary according to the person«ilitics of 
their associates, the temperaments of their immediate superiors. But such 
factors were unpredictable. The personnel had a way of changing from 
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month to month. At one time it would be rumored that a certain overseas 
branch was very badly managed: anyone who could not tolerate a good 
deal of snafu would become a nervous wreck in no time. A litdc later 
we would learn that things were moving very smoothly there under a 
new chief. And so it went. 

MovSt of our inffu'in:itu)u was ol)talnetl from the hrauch chiefs and tlicir 
administrative officers in Washington, Ihii much of what has just liecn said 
about us is also some extent appUealdc in them. I'ew, if any. had ever 
operated in the fielrl. Mtisi of diem had been drawn from civilian life nml 
were doing their level best to learn a new game, the rules of which were 
changing from season to season, or even from week to iveck. To he sure, 
a few of the administrators had visited OSS headquaricis in tiistarit rheaters, 
but tlic knowledge they accjuirecl there was out of date a feuv months 
after they returned; and much of whnt they could remember they wv.rc lot) 
busy to impart or unable to communicate in terms tliat were usable l)y us, 
They did more than could reasonably have been expected of them, hut it 
was nevertheless a long time befrue the assessment stuff was able to piece 
together bits of information frtim various sources and arrive at aricciuaie 
conceptions of the jobs that needed iilling. 'The following excerpt is fairly 
typical of die form in which our informaiinii was received. We would class 
it neither among the least nor anumg the most helpful a)rnrnunit:aticins 

that were sent in from the theaters. It is about average, 

The organization has tiecn recruiting too many men, civilian nr ni Hilary, wlu^ 
have intelligence and sometimes the necessary mechanical training but wlm lack 
common sense, know lunhing about working with men or linw tr) look after 
the welfare and the morale of men under them. We sim[)ly rnusr have tnen 
who can shoulder rcsponsihiliiy and use initiative with common seme. Simply 
because a man has intelligence docs not qualify 1dm for fids type of work, In 
some instances we also have had men who fall into the class (tf the high sirung 

Of emotional type. We simply cannot use men of that type in die field when 

dicy have to live \vid\ Chinese, cat Chinese food, and be iimlcr pressure at times, 
[n most eases these men have suffered nervous breakdowns and other nervous 
ailments. Whether men are recruited in the States or here in dre field 
they must be checked by a doctor and n psychiatrist heforc Ixdng pronounced 
fit for the field. The check by a psychiatrist is especially desirable. If for the 
Army and Navy there have been provisions made for psycliiatrlc checks, then 
for us It is more important since our men spend from three to six months in 
the field without seeing American installations. We have harl at least eight men, 
who for various quirks in their make up, luivc luul in he pulled from dm field. 
Some of diem coultl have been used at hcadtiuaricrs and sltnuld never Itavc Item 
sent to die field, and oihers simply wnuUln’t fit anywhere, One was definitely a 
psychiatric cased 

-It should be said dmc the breakdowns mentioned in this mcs!;i/rc maairrcd in men wlio had 
not been previously assessed. 
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Many of the projects were planned at theater headquarters, in London, 
Algiers, Cairo, Kandy, or Kunming, and it was there that the personnel 
requirements for each project were determined. The Washington office 
was merely informed that so many men of this and of that type were needed. 
It takes an expert to write a job description, and no experts in the theaters 
were free for such tedious employments. Consequently, in no instance was 
the information received in Washington as precise as it might have been. 
Furthermore, by the time the recruiting officers of the OSS Personnel 
Procurement Branch had engaged the interest of the required number of 
prospects, the specifications that had been sent by the administrative officer 
overseas were lost in the files of the corresponding officer in Wasliington, 
In any event, when a candidate arrived at the assessment station there was 
usually but one term (language expert, news analyst, team member, carto- 
grapher, or the like) on his Student Information Sheet to designate the 
nature of the assignment. It was months before these brief designations were 
successful in evoking in our minds images of definite duties that the can- 
didate would be expected to perform. 

In the beginning, the judgments of many of us were confused by the in- 
fluence of an enduring lodger in our minds, the figure of the Sleuth, acquired 
from Somerset Maugham’s British Agent, from Helen Macinnes* As- 
signment in Brittany^ from the thrillers of E. Phillips Oppenheim, and 
from who-can-say-what motion pictures and detective stories. Even the 
legendary cloak-and-dagger hero may have come into It. But that was 
natural enough. In those days our heads were empty billets waiting to be 
filled, and in the absence of the figures we had invited — images of operators 
in the field— a number of theatrical deceivers moved in and made them- 
selves conspicuous. These intruders were driven out one by one and replaced 
by the proper personages eventually— (i) when the branch admini.strativc 
officers finally received job specifications that were more precise; (2) when, 
many months later, some of the men who had served in the field returned 
to Washington and devoted hours of their time to answering our questions; 

(3) after several of the assessors had taken the course at one or another 
OSS school and learned most of the tricks that were taught agents; and 

(4) after a few other members of the staff had crossed the ocean and 
come home with firsthand observations. 

Heterogeneity of the Jobs Proposed for Members of Each Group 
of Candidates.— Each British selection board was limited to the task of 
deciding suitability for one type of job, and so, at each station, a unified 
program could be set up with an interrelated variety of procedures to test 
the different functions that comprised a single role. These functions could 
be kept in mind by the assessors as they witnessed the performance of the 
candidates. In contrast to the British boards, the assessment stations in the 
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United States were expected to estimate suitability for a great variety of jobs. 
This expectation would not have been nearly so embarrassing if the mem- 
bers of each group that came to be examined had been recruited for jobs of 
the same general class; one group, say, composed of prospective administra- 
tors— branch chiefsj branch administrative officers, finance officers, supply 
officers, and so on; another group made up of prospective field o[>crators: 
including parachutists, instructors and leaders of guerilla units, mortar 
experts, saboteurs; and a third consisting of propagandists: idea men, 
script writers, radio speakers, actors, artists, and the likc» IE this practice 
could have been instituted, it would have been possible to construct a 
number of different programs, each restricted to testing the qualities most 
necessary for a single class of jobs* 

But homogeneity was out of the question. The candidates had to be 
taken pretty much as they arrived, regardless of the jobs pro].X)scd for them, 
They could not be kept waiting. It was always hard to find rooms for 
tliem in the city. No one was tolerant of delays. Either a candidate would 
be accepted, in which case the branch administrative officer was bent on 
having him start his course of training as soon ns possible, or he would 
not be accepted, in which ease he was usually anxious to return to 
the work that he had clro})pcd abruptly on being summoned by OSS. 
As a result, a "class” of "students” at one of the assessment stations was 
apt to contain men selected for at least six or seven diilcrcnt kinds of jobs. 

Since what we had available in tlie way of staff, facilities, and time did 
not permit the carrying out of six or seven different programs simultane- 
ously, a more or less uniform schedule was established, parts of which were 
necessarily irrelevant to the question of the suitability of one or another 
class of recruits, Thus unavoidably a few of the hours of each man were 
wasted by us instead of being used gaiufully by having him engage in 
activities that were pertinent to the duties he was slated to perform. 

Also, the heterogeneity of the jobs to be considered eliminated the possi- 
bility of a unified orientation on the part of the assessors. Each focus of 
attention (candidate) called for a special frame of reference (job descrip- 
tion— when we had it). For example, observing candidate Bud at meals, 
or during an interview or outdoor group test, one had to ask oneself: Will 
this man survive the rigorous training in Scotland? Will he get along with 
the British? Will he be able to govern his anxiety up there in the plane as 
the moment for the drop approaches on that fateful night? Will he favor- 
ably impress the members of the resistance group into whose territory he 
will jump? Is his French fluent? Will he make a good instructor? Will 
he play safe, or will he manifest initiative and daring in setting up road 
blocks and harassing the Germans generally? Will he find isolation in a 
lonely farmhouse tolerable when he hears that the Gestapo arc searching 
for him in the neighborhood? Can he hold his liquor? At one of those 



16 Assessment of Men 

dinners the French will give in his honor will he rant and boast of the 
prowess of America? Will he get mixed up in politics? Will he succeed in 
persuading the rival French factions in his locality to cooperate or arc his 
actions likely to incicase antagonisms? 

Sitting next to candidate Bud at breakfast, or entering as he left the 
interview room or working alongside him in the group test, was candidate 
Roy who was slated for another job operationally defined by other images. 
Here one had to ask oneself; Will this man tolerate with equanimity 
the monsoon season in Calcutta? Will his mind provide a barrier to 
irritability when his body breaks out with prickly heat and athlete’s foot? 
Has he a good head for business? How much does he know about the 
transportation of supplies? Will he increase or lower the morale of those 
about him? Will he spend so many of his evenings in nightclubs with OSS 
girls that his working efficiency will be impaired? By perpetual kidding 
and gossiping will he create in his office a frivolous playboy atmosphere? 
Will he treat the Hindus with patronizing condescension or contempt? 
Will he do anything to discredit the organization in the eyes of the 
British? Is he so rank-centric that he will whine and grouse when his 
promotion is postponed? If he is transferred to less desirable quarters or 
shifted to another job involving less interesting or important duties, will 
he feel slighted and humiliated to the point of losing zest? 

Next to be considered, let us say, was a man who had been selected as 
a liaison pilot for the Mediterranean theater, a job which was represented 
by another set of images; and then after him, a candidate with still differ- 
ent qualifications, and so on down the line to the last man. 

Now, human minds are hardly capable of regimenting so many images, 
hardly capable of calling forth the catalogue of a single cluster at the 
proper moment and holding back all others. Therefore, the heterogeneity 
of the jobs which had to be considered during each period of testing was a 
condition that interfered with clear thinking and so, no doubt, decreased 
the reliability of our predictive judgments. 

Impossibility of Testing Special Skills.— The great diversity of particular 
skills called for by OSS projects presented a problem with which the 
assessment staff found itself incapable of dealing satisfactorily. It devised 
tests of a number of special aptitudes: ability to observe, remember, and 
report, ability to analyze news, ability to improvise subversive propaganda, 
ability to instruct, ability to recruit, and so forth. It also used certain 
standardized tests, such as one for aptitude in using the Morse code and 
one for mechanical comprehension. But for many other skills there were 
no already accredited tests on the market and it would not have been 
possible for the assessment staff, fully occupied as it was, to develop and 
standardize thirty or forty tests to cover such activities as policy making, 
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calculating enemy viilncrahilities, cdiiing an Austrian ncwspaj>er, practicing 
tropical medicine, nunsing, parachuting, uiulci water switnniing, training 
homing pigeems, running a linotype machine* drawing Japanese jx)stors, 
and so forth. And then tlicrc was the great problem of language. We had 
no one tm the .stall who was lliicnt in Rumanian* Allianiun, nKjdcra Greek, 
Danish, Malay, and so [orth. It would, in trutli, have retjuired a siaif of 
twenty or thirty ex[)crts m pass jiidgmciu on the degrees of .s(X’Cuil talent 
possessed by the loialiiy of our candidates. 

Consetjuently, estimations of rare proiiciencies were left to the branch 
administrative ofikers and to the recruiters of tlie Ikrstmnd PncurcmciU 
Branch* who had to come to their conclusions on the basis of work history, 
reports of others, personal acquaintance, and the candidate’s^ estimate of 
his own qualifications. 

Thus, in many casSes, special aptitude, the most important varialilc in 
determining succcSsS or failure in the theater, was all hut excluded from our 
deliberations. The men who failed in the theater hecatise of iiusu (lie lent 
technical skill were nevertheless counted among the errors of aSvSessincnt. 

Degrees to Which Jobs Differed from Anything (mndidates Hiid 
Done Before,— Demcxracics arc congregations of peace-minded citl/ciis. 
War coming up as quickly as a cyclone catches them unprc[iared. ICveryonc 
must hurriedly learn new tricks. 'rln.s lime, because of the tot.d nmkiplex 
character of World War II, there was an unusually large number of new 
tricks to be learned. Jumping from a plane, for example, winch is a 
triumph of the will over one of our least managealile instinctive fears, is 
not a common civilian pursuit, (OSS, however, did recruit a man who 
claimed to have jum[)cd over 2,3(K) times.) 

The novelty of so many (>f die assigntnerus is inclutled among the siiecial 
conditions which distinguished our task from ihat of so many other seda:- 
tion boards, because the greater the novelty of the job the more unrchable 
is the work history as a guide for inference. Since the work hlstmy is the 
granite on which vocational judgments depend most for their suiiport, it 
is worth noting that in many instances we could build no argument on this 
since it bore no relation lo the proposed a.ssignment. I^ven when the tratish 
tion from past to future involved a shift so .slight us tluu between research at 
a university and research in Washington, adjustability to new conditions was 
often the decisive variable, Judgment as to the suitability of an eminent 
political scientist recruited for rcsearcli and analysis, for example, would 
always rest, to some extent, on evidence that was pertinent to this ciucsiioiu 
Will this man be able to shift gears and work under pressure, turning mu 
memoranda, well ahead of military action, which are accurate, terse, 
organized for quick comprehension and pointed toward strategic decisions? 
The degree of transformation of old habits that was required of most 
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candidates was far greater than this, and it was our job to determine whether 
or not they would be equal to it. 

Heterogeneity of the Recmits: Strangeness (to Us) of Many of Them. 
—To fill the great diversity of positions mentioned earlier, individuals of a 
wide variety of backgrounds were recruited, and this made assessment 
difficult for American psychologists, most of whom were unfamiliar with the 
conventional assumptions, patterns of behavior, and modes of speech of 
Spaniards, Greeks, Albanians, Yugoslavs, Rumanians, Hungarians, Aus- 
trians, Germans, Poles, French, Hollanders, Chinese, and Koreans. There 
was not only the language impediment— many of these foreigners and 
first-generation Americans were embarrassed by their halting and stumbling 
use of English, and allowances had to be made in rating their written work 
—but there was our own uncertainty in trying to interpret properly some 
of their actions, gestures, and insinuations. Furthermore, it was not always 
easy for them— aliens in a group of hearty Americans— to adjust to the 
assessment situation, or easy for us to guess how they would act in other 
environments. Take that stubborn lantern-jawed fellow over there who is so 
irritating to his fellow candidates; is it not possible that he is the very man 
to appeal to a band of guerillas in the mountain paSsSes of All)anta? And 
observe that Frenchman gesturing so excitedly to that slightly scornful 
circle of Americans; how effective would his relations be with the leaver, 
middle, and upper classes in his native countryf It was hard to find 
solid ground for deciding questions like these. 

Occasionally when we had a class composed entirely of Japanese, one or 
two cultural anthropologists, acquainted with the patterns of conduct preva- 
lent among these Orientals, would help us by joining the stall for the dura- 
tion of the testing period. But, for the most part, we had to feel our way 
through the complexities of cultural differences as best we could, blindly 
and without aid. Several of the errors we made can be attributed to our 
inclination to give foreigners the benefit of every doubt. 

The difficulties of cross-cultural assessment become apparent when one 
listens closely to appraisals of his own countrymen by foreigners. For 
example, although numerous American groups were very successfully 
assessed by British boards, striking misinterpretations of the behavior of 
these men were not infrequent. 

Difference between Jobs Assigned Men in the Theater and Tho.se 
for Which They Had Been Assessed. — This difference was inevitable. 
During the two, four, six, or even eight months that elapsed between the 
day that personnel for a certain project were requested in the theater and 
the day that the men arrived there, the situation in the area had usually 
changed considerably. Perhaps the original plan had been abandoned for one 
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reason or another, and new and more urgent uiulertakings were being 
launched. Incompetent men here and there had been released; illness had 
claimed odrers. Branch heads were clamoring for substitutes. As a rcsulr, 
a new arrival might very well be given a task for which he had been 
neither recruited, assessed, nor trained. 

During most of their existence, Stations S and W were expected to judge 
the suitability of each recruit for a selected assignment, nothing more. Some- 
times the writer of the evaluation note would .state that the candidate was 
recommended for the designated jtjb prfjvidcd he wf)uUl n(Ji he cxpccicd 
to perform this or that function, but the assessor would have been over- 
stepping the bounds of his function if he hatl suggested an entirely rlifTcrent 
mission for wbicli the candidate ap[ic:ircd to be better fitted. It is hard to 
account for the fact that thl.s policy was maintained long after it was dis- 
covered that there was no certainty as the job the candidate would be 
given in the theater. Anyhow, adjustability to a variety of assignments came 
to be regarded at the assessment stations as an asset that might very well 
be critical. 

About three months before the war was won a new form of reptirt sheet 
was belatedly adopted. This called for a fitness rating not only frtr the job 
selected for the recruit, but also for each of several oibcr classes or ty[)c.s of 
jobs. The purpose here was, first, to give the branch chief in the theater 
some assistance in placing a man in a position other than that for which 
he had been chosen in the United vStates, and second, to give the staff the 
opportunity to record their impressions of each man’s fune.ss or unfitness ftjr 
other kinds of work, so that, whatever role was eventually assigned to him, 
there would be an asscs.sment rating with which the final rating of per- 
formance in the field could l)c compared. However, since tionc of the men 
so rated had time to get into action before the cessation of hostilities, all of 
our follow-ups and our evaluations of assessment [procedures were done on 
men whose suitability was rated for one job only, a job whlcli not infre- 
quently was different, as we have stated, from the one which became his 
eventually, Such considerations notwithstanding, in our calculations all 
failures in the field were counted us errors of assessment. 

To summarize the chief factors so far discussed, it should be stated that 

(i) it was not possible— because of the nature of OSS aciivitics— to obtain 
adequate job descriptions, the first requirement for an assessment program; 

(ii) it was not possible for any one staff at any one station to test suitalpility 
for such a great variety of novel assignments; and, even if it had been 
possible, (iii) the job that the candidate was assigned in the theater was in 
a large proportion of eases different from the one which had been selected 
for him in Washington. 

This being the situation, it was decided at the start that we would judge 
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each candidate not primarily in relation to our conception, such it was, 
of the designated mission, but in relation to a set of general qualifications 
(dispositions, qualities, abilities) which were applicable to the great majority 
of assignments of OSS personnel overseas. How this was done will be ex- 
plained in the next chapter. 

Now let us turn to some other conditions— further hindrances encountered 
in attempting to arrive at clear conceptions of the personalities and at valid 
estimates of the capacities of the candidates examined, 

Variations among Recruits in Temporary State of Health, I^hysical 
Training, Mood.— Some men were in the pink of condition when they 
came to assessment, others were in the clutches of a severe cold, or depleted, 
or otherwise out of sorts. Some who had been confined to sedentary occupa- 
tions for years, and had not recently engaged in physical exercise, appeared 
at a great disadvantage alongside young men fresh from basic training, or 
from officers’ candidate school. Some recruits, who had spent a restless, 
wakeful night on the sleeper hurrying to the city where they were Lo rc[iort, 
were forced to whip their brains to keep them pulling for four hours during 
the first evening of written exercises. One candidate had just come fr(»m the 
bedside of a sick child, several were in the midst of divorce proceedings, 
some had suffered recent reverses in business. The wife of one candidate had 
shot herself in the abdomen accidentally and was undergoing a surgical 
operation at the very time her disquieted husband was doing his best par- 
ticipate in the to-him-empty assessment situations. 

These temporary factors, and their name is Legion, were so diverse, so 
subtle, and so varying in their effects that it was not possible to be certain 
what correction should be made for them. Thus we must list this uncon- 
trollable variable among the conditions that increased the difficulties of 
assessment. 

Variations in the Amount of Previous Information Recruits Had 

Acquired Concerning Assessment Procedures Some men were given 

no clarifying information about the OSS and its activities by the officer who 
recruited them, and on arriving in Washington were sent to Station S or 
W without any explanation* of what was afoot. They arrived at the 
assessment center in a state compounded of amusement, curiosity, mystifica- 
tion, confusion, defensiveness, and resentment, thg proportion of these feel- 
ings varying with their temperaments and the type of treatment they had 
received along the way. The degree of error that is possible when a man 
first enters one of these hush-hush agencies is Illustrated by the candidate 'who 
started the testing program under the impression that he was being con- 
sidered for a position in the State Department. At the other extreme were 
those who, having worked for a year or more In the OSS in Washington, 
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had been able, from stories indiscreetly passed on to tlicrn by former "grad^ 
nates’’ of assessment, to jmccc together fragmentary conceptions of tlie pro- 
ceedings which served to prepare them for the shocks to come. 

Although at the end of each testing period the recruits were enjoined nm 
to tell anyone until the war was over what hapjiened at fi or at \V, it was 
not easy for them to ctjmply with this regulation. For tnosi of thtjse who 
went to Station vS, the three clays in the country was a novel, stimulating, and 
stressful experience, sometimes hnmiliatitig or annoying, hut almost always 
memorable for one reason or another. They were full of it all wliicn they 
returned Co town and when they came together with other graduates this 
was an almost irresistible topic of conversation Their reminiscences were 
occasionally overheard by men who were destinecl to go to one of these sta- 
tions at some later date. In any event, the few men who arrived at S or at 
W with some preparation had an apiu'ccialde advantage over the innocent 
and unsuspecting raw recruits. Here again was an nncontridlablc variable 
which undoubtedly influenced the emotional and intellcrtual set with wliich 
the candidates faced their tasks at the assessment center. 

Anonymity of Clancliclates.^ -Since the administration had decided that it 
would be better for security reasons to keep the personal idcniiiy name, 
family and vocational background, rank, and .so oiv^ of each recruit un 
known to his fellows, it was arranged to have all the candidates leave I heir 
own clothes in town and come out to Station S dressed in Army fatignrs, 
each with an invented pseudonym to distinguislt him during the perintl of 
testing, Although this practice opened tlie way for some otherwise unwtrrk-' 
able procedures and facilitated the creation of a convivial aimosphcrt% in 
other ways it augmented the diflicuhics of assessment. 

In the first place, it deprived the staflF of stunc of the cues that are eorn^ 
monly utiliml in judging charactcr-^thc material, cut, and c(u\dicitm of a 
man’s clothing, the color-pattern of his tie, the folds am! creases of his hat 
and the angle at which he wears it, how he carries his handkerchief, with 
or without a monogram, and so forth. In those instances in which the candi- 
date wore his own socks and shoes, these, as stde indicators *»£ taste and 
social status, received an unusual amount of attention. 

The advantage of being able to observe the candidates in the garb of the 
Common Man, dispossessed of all symbols of autlun'ity and station, was 
further offset by the fact that under these condition.s some men act in a 
manner that dilTcrs from their manner in real life. Take the bufjyam, .suc- 
cessful journalist, for example, who, caught in the draft at the age of thirty- 
four years, had been somewhat shamefacedly wearing the stripes of a T/5, 
At the assessment station, this man, rid of the uniform that suppressed Ins 
spontaneity, came into his own again. The somewhat tense young man of 
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twenty-eight, on the other hand, who had enlisted before Pearl Harbor 
and risen rapidly to the rank of major, lost, when stripped of his leaves, 
some of the support upon which his mounting confidence had been relying. 
As a result, the older and more sophisticated writer conveyed an impre.ssion 
of greater self-assurance at assessment than did the young officer. But 
transplanted back within the framework of the Army hierarchy, it was not 
unlikely that the journalist, deprived of certain privileges, or pushed around, 
would find alcohol an inviting refuge from a humiliating position; whereas 
the young major, heartened by evidences of respect, might very well outdo 
himself in striving to live up to his official role, 

Thus the wearing of fatigues at the assessment stations served to conceal 
if not to obliterate the often powerful effects of rank differences. As a result, 
predictions of the subsequent effectiveness of enlisted men were apt to be 
too high; those of field grade officers, too low. (Another factor tending in 
the same direction was the operation among our staff members of senti- 
ments favorable to the less appreciated man, the underdog.) 

Length of Time That Elapsed before Securing Evaluation of As- 
sessment Ratings — After being passed at one of the assessment stations in 
the United States, a man would usually spend from one to three montlrs in 
attending OSS schools and awaiting transportation out of the country. It 
might be two months more before he was well started on a definite a.s.sign- 
ment overseas. And then not until another month or two had passed would 
his superior officers and associates feel that they had enough evidence on 
which to rest a judgment of his efficiency. Thus one had to wait anywhere 
from four to eight months to evaluate an assessment rating; and to do it 
even as quickly as this it was necessary for a member of the assessment 
staff to go overseas himself and collect appraisals in the theater. By the time 
he had returned to Washington and written up his report, six to ten mf)nths 
had elapsed. The first evaluation reports on 137 cases appraised in the ETO 
were finished in late October, 1944, ten months after Station S was started. 
Thus, for this long period the assessors had to proceed without knowing 
what proportion of their shots was missing the target. Furthermore, the 
early reports from overseas did not include the information that was required 
to appraise the efficacy of the different procedures. And no one on the staff 
was free to make the necessary statistical correlations, to determine the 
degrees of conformity that existed between the S or W rating.s on cacli 
variable on each test and the ratings given in the theater, Validating corre- 
lations of this sort constitute the best ground for deciding which tests .should 
be retained without modification, which revised, and which eliminated. The 
OSS psychologists and psychiatrists, fully occupied with the routine of assess- 
ment, were unable to obtain these figures until after the war was over. 
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This will suffice as a list of the chief complications which confronted the 
OSS assessment staff. The clcvscription of these conditions has served, wc 
hope, to define the nature of our task as distinguished from that of the 
average selection board. Two other important differences deserve brief men- 
tion. 

High Quality of the Majority of OSS Candidates. — The OSS hf>ard had 
to appraise the relative usefulness of men and women who fell, for the most 
part, in the middle and upper ranges of the dlstrilnuion curve of general 
effectiveness or of one or more special abilities, people who had already been 
selected because of demonstrated skill in some field of activity. OSS stand- 
ards, in other words, were somewhat higher than those of the majority of 
institutions which make use of screening devices. Consequently, some of the 
tests which are successful in distinguishing people who, because of some 
defect or handicap, arc incapable of functioning effectively, were not suitable 
for our program. 

Necessity of Judging Social Relations*-^^-As was mciuirmed above, the 
OSS psychologists and psychiatrists were expected to estimate a candidate’s 
ability to cooperate and to get along well with odicrs, and also, in the m;v 
jorlty of cases, his ability to lead, to organi'/x the activities of oiIkts, and if) 
evoke respect Since there arc no standardi'/xd procedures for measuring 
these qualities and abilities, new methods had to he improvised. 

The difficulties listed above, by challenging the imagination, acted as 
stimulants to the mcmher.s of the staff rather than as depressants; further- 
more, they were balanced by certain rather tmusKul advantage's whicli greatly 
facilitated the process of assessment, 

Excellent Locations for Assessment — Except for its roominess there 
was nothing noteworthy about the drab brownstone building in Washing- 
ton, D. C.y in which the W staff carried on its operations; but the country 
house and farm in Fairfax County, Virginia, where Station S was located, 
and the beach club facing the Pacific, which wtis known as Station WS, 
were both peculiarly suited to the requirements of a comprehensive as- 
sessment program. Sleeping, messing, and recreation facilities were arlequatc 
for candidates and staff at both places. There were small rooms for inter- 
views and large rooms for the admini.stration of group procedures; an<l, 
outdoors, particularly at S, the terrain had plenty of features which lent 
themselves to the construction of tasks to test physical and mechanical com- 
petence, cooperativeness, and leadership. 

Although it might have been better to select or prepare locations which 
would strain the candidates* tolerance of ugliness, dirt, disorder, and dis- 
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comfort, the beauty of the landscape and the agreeablencss of the architec- 
ture at S and at WS were sources of great satisfaction to the stall members 
who worked at one or the other station month after monthi rurthetmore, 
the candidates’ delight in finding on arrival that they were to live amici 
such attractive surroundings was an important determinant of their enjoy- 
ment of the three-and-a-half day period; it lifted their morale and in- 
creased their capacity to endure the ordeals and humiliations which they 
experienced along the way. Thus periodically stressful tasks were imbedded 
in a satisfying setting, the result being that, in the end, the rivcr-all im- 
pression of the majority of assessces was pleasant rather tlian unpleasant, 
We were assured that several other factors— the friendly atmosphere, the in- 
formality and zest of the staff members, the novelty of the test situations, 
the orderly manner in which the program was administered— entered into 
the creation of the candidates’ largely favorable judgment, a judgment which 
in numerous cases was generalized to include the entire organization, For 
instance, several S “graduates” informed us that the asses, sment iirogram 
engendered the belief that, since the OSS took such pains in the selection of 
its personnel, it must be a pretty fine outfit. Anyhow, in many oases, the 
process of assessment served as a morale-raising force, and the point that 
we are stressing here is that one of the components of this force was the 
agreeable environment in which the program was carried nut. 

Moderate Flow of Candidates.— Although the asscs-sment .staffs operated 
under full steam most of the time— not often did the work at Station S end 
before midnight — the pressure was due to the fullness of. the schedule rather 
than to the number of candidates that bad to be a,sscsscd. It would have been 
simple enough, by omitting a few procedures, to m.ikc time for the e.xamina- 
tion of more candidates— or, possibly, for a spot or two of leisure, ikit none 
of the staffs saw fit to do this. 

In the beginning (January, 1944), Station S assessed candidates at tlic rate 
of 120 per month, but before the winter was over this number had risen to 
almost 250, which was judged to be too heavy a load for the .system tliat had 
been adopted. Another assessment unit. Station W, with a one-clay schedule 
of procedures, was therefore set up in Washington. This change decreased 
the flow at S and so permitted a slight reorganization of the program, which 
lengthened the testing period by half a clay and allowed for a short period 
of relaxation between the departure of one group and the arrival of anotlicr. 
This new schedule provided for the screening of 6 groups (“classes”) of 
about 18 men each (a total of 108 candidates) per mouth. Station W 
assessed candidates at the rate of about 200 a month. In June, ic)44, Station 
WS on the Pacific coast was opened. These three units -S, W, and WS— 
were able to handle all the personnel recruited for OSS during the height 
of its procurement season. When six months later the flow of candidates in 
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the West (ieert'iiM.'(l, WS was dosed, For the leinainiiig eight month, s all the 
screening in America wa.s clone at S and at W. 

All told, 5,^191 pcr,STjn,s were a.s,se,s,sed in the United Statc,s between Dcecfn- 
her, 1943, and Augirst, 1945. thi,s number of recruits 

it would have been ncec,s,sary either to organiw more asscs.stncnt units or 
to abandon the ihrce-day program. 

Adequate Stalf.~-l'ho,sc who ,sharcd the r(;.spon.sibility of setting uji the 
a,sscssmcnt program were exceedingly furiunate, first, in being unrestricted 
by the administrators nf OSS in respect to the number of men and women 
who might he recruited for the various stafTs, and second, in being able 
to find enough trained psychologi,st,s' and psyehialrist.s to carry out and 
develop the program in accordance with the methodological principles that 
were ira[)licit in the original conception. These principkss will Ik discus.scd 
in the next chapter. 

Not until Station S reached the terminal pha.sc itf it,s c.ircer, however, 
did its stall find one man of the .sort it had wanted since the heginniiig: a 
man who had served overseas, who was not a [isychologist or a psychiatrist, 
who wa.s able to size men up impartially, and who was eager to join the 
staff as an additional ohservef, 

In summary, then, it might be .said that the task which was undertaken by 
the OSS psychologi.sts and psychiatrists was that of evaluating the geiicnd 
usefulness f)f about 300 men and women a month, very diverse in rcs{icct 
to age, cultural background, and talciit.s, and judging the binr.ss of each for 
a particular as.signmcnt, the nature of which was but vaguely designated. 
In their attempt to accomplish this task they were suppiried by (icncriil 
Donovan and other members of the adminstration in every conceivable 
way. They were given excellent locations and facilitie.s, a free hand in 
recruiting new .staff memhers, and, from first to last, ample cncoiirageniciit 
and cooperation, 
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PRINCIPLES OF ASSESSMENT 


In designing the program o£ procedures for Station S, the staff was guided 
by no precisely stated methodological principles. The truth is that, although 
certain technical rules— for psychiatric interviewing, for constructing and ad- 
ministering aptitude tests, and so forth— are widely accepted, no general 
principles of assessment have been established, largely because the laws of 
personality on which they must be founded have yet to be formulated and 
verified. 

It is hard to believe that the members of ' the assessment staff— clinical 
psychologists of various persuasions, animal psychologists, social psychol- 
ogists, sociologists and cultural anthropologists, psychiatrists who had prac- 
ticed psychoanalysis according to the theories of Freud, of Homey, and of 
Sullivan, as well as psychiatrists who were unacquainted with, or opposed 
to psychoanalysis— these diverse specialists, men and women accustomed to 
much free thinking, recruited from a dozen states, were able to work 
together enthusiastically, harmoniously, and effectively, according to an exact- 
ing schedule of daily duties, without ever meeting to compare and integrate 
their theories, without trying to reach a tentative agreement as to the nature 
of personality or as to the best modes of formulating its variations, without 
ever discussing the postulates of assessment, the principles to which they 
should adhere in designing the program and in recording, interpreting, and 
evaluating the activities observed. 

In the first place, there was no time for such discussions. In war, every- 
thing must be done quickly. This was the rule in the OSS. If we had 
set aside a period at the start to discuss fundamentals, the date of launching 
the project would have been postponed or, if we had done this later, the 
steady flow of assessments would have been interrupted. 

In the second place, there was a half-conscious tacit realization— shared, 
it seems, by the majority— that frank discussions on the conceptual level 
would reveal radical disagreements which might, by disturbing interpersonal 
relations, interfere with the smooth functioning of the unit. 

This willingness and ability to cooperate without a clarification of prem- 
ises, without defining and rationalizing the ultimate aims and values that 
arc basic to the common enterprise, is typical of English-speaking peoples, 

36 
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more especially of Americans. It seems lo he an acciuircd habit, a resultant 
of our democratic way of life, of the intermingling and necessary collabora- 
tions, in the United Stales, of persons of irreconcilable cultures, of years of 
religious tolerance, if not indilTercncc, ending in the assumption that hcliefs 
in themselves arc of negligible Import, of our short-range inatcrialistk out- 
look, of the widespread belitilrmcnt theory and the excessive preoccupa- 
tion with facts, acts, and gadgets. 

That there had been some suppression of theoretical convictions at Station 
S was indicated by the outbursts of divergent views that occurred as stnm 
as the practical work had been comi)lctc<l, wlicn those of us who remained 
turned to the task of evaluating our policies and practices. 

Still, the fact that we had been able to work together so harmoniously 
seemed to justify the belief that we enjoyed a broad, though perhaps uncon- 
scious, basis of agreement, that most of us had been acting on similar OsS- 
sumptions despite differences in our preferred ways of drafting them. It 
was this supposition that encouraged us to plan to devote this chapter to 
an exposition of the rationale of our program, of the principles which were 
implicit in everything that we did in common. 

We thought, in addition, that it would lie possible to carry the logical 
process back one step further and arrive at the psychological [mstulatcs 
which conformed to the stated principles of assessment. These [lostulatcs 
could then be compared to all the fnct.s and theories of [icrsonality svich 
which we were familiar. IE it was found that the po.stiilalcs were in 
accord with current knowledge then we would be in [Kisscssion of the 
best possible theoretical foundation for our tcclinical practices. If not, adjust- 
ments would have to be made. Either the principles and methods of as- 
sessment or some of our contemporary theories, or both, would have to be 
modified. 

In presenting a conceptual framework for the OSS system of assessment 
we did not suppose that It would be possible to include the whole range of 
theories and hypotheses entertained by the men and women who, at one 
time or another, had taken part in the undertaking. As we have said, their 
views were never expressed except incidentally ami ’‘off the cuff" in a frag- 
mentary manner. But we did expect that we could arrive at a number of 
generalizations to which most members of the staff would give assent, To- 
gether we had garnered an abundant harvest of experiences; would it be 
right to leave the sheaves standing, the grain iiiuhreshed? Preferable to this, 
in our judgment, was to allow three or four members of the staff, unrepre- 
sentative as they might be, to work the material and extract what scientific 
nourishment they could from it* 

This decision gave rise to several months’ labor on die conccj>cuaI level 
which resulted in a brood of theoretical propositions, But when these were 
finally examined with a cool, impartial eye, the impression was Inescapable 
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that they were not of the sort that would be accepted readily by a majority 
of the staff members. Regretfully we concluded that any serious attempt to 
define basic concepts and postulates underlying assessment practices would 
lead almost inevitably to new conceptions, very possibly requiring new 
terminology, which, at best, could scarcely invite immediate and unanimous 
approval. 

There was no possibility of testing this suspicion by assembling our 
collaborators, most of whom, at that date, were scattered far and wide, some 
in the Far East. A symposium was out of the question. And so it was de- 
cided that, rather than run the risk of publishing theories to wliich many 
of the staff could not subscribe, it would be better to curb ambition, scrap 
our speculations, and resign ourselves to the more modest task of explain- 
ing the OSS system of assessment on a relatively concrete level and then, 
possibly, of setting down a few of the assumptions about personality on the 
basis of which our procedures could be rationalized. This chapter is our 
attempt to do just this and no more. 

The scheme employed by us might be called the multiform organismic 
system of assessment: “multiform” because it consists of a large num- 

ber of procedures based on different principles, and “orgar .smic” (or “Ge- 
stalt,” or “holistic”) because it utilized the data obtained through these 
procedures for attempting to arrive at a picture of personality as a whole; 
i.e., at the organization of the essential dynamic feature."! of the individual. 
The knowledge of this organization serves as a basis both for understanding 
and for predicting the subject’s specific behavior. 

The system may be set forth most simply as a scries of steps each of which 
is based on one or more psychological principles, 

Every step described below is either one which was taken by us or one 
which would have been taken by us if conditions had permk.ccl it. 

At the end of the undertaking, a rigorous analysis of our rest disclosed 
errors which could be attributed to methodological defects, for each of which 
reflection yielded remedies. These remedies are described in the last section 
(Recommendations) of Chapter X. Consequently, the reader must combine 
pertinent parts of this chapter and of the final chapter to obtain a full 
account of the guiding principles which we would advocate today. 

Step 1. Mat^e a preparatory analysis of all the jobs for which candidates 
are to be assessed. This step, of course, is fundamental, since it is impossible 
to predict whether a given person, no matter how accurately his skills are 
estimated, is suitable for a job of an unknown nature, To state this more 
generally, it is impossible to predict whether one thing, A, which is present 
and open to measurement, will fit another thing, B, which is absent, if the 
dimensions of B arc not known. 

As explained in Chapter I, this most important first step in an assessment 
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program could not be achieved, except to a slight extent, in setting up the 
OSS screening process. Furthermore, we were unable to recruit, as mem- 
bers of the assessment sialT, men who had had military experience overseas 
of such a nature as would equip them to judge, without the henefu of job 
analyses, the suitability of candidates for OSS assignments. Therefore, as 
already described, our conceptions of the various jobs were products of our 
imaginations working with the few facts that were supplied by branch 
chiefs, their administrative officers, and other administrators in Washington. 

Inasmuch as the duties of the OSS assessment staff did not include the 
measuretneiu of a hundred and one highly technical skills, analyses cjf the 
latter were not required. Hence, in this respect, our task was less inclusive 
and exacting than that of other selection agencies. 

At the time of the initiation of the program the members of the stall 
did not realize how thoroughly this first step, or principle, shoulel be ap- 
plied in order to justify a scientific system of assessment. They did nf*t realize 
that besides obtaining (i) a functional analysis of each role and ( 2 ) an 
analysis of each of the physical and social environments in which tlicsc roles 
would have to be {Xirformed, it was necessary to design, at the very start, a 
satisfactory system of appraisal (validation), which would inclmle (^) a scale 
for theater ratings of effectiveness in tlie performance of each function. The 
members of the staff, at this early dale, did not distinctly see that the actual 
target of their undertaking, the standard against which iheir eifr^nv would 
eventually be evaluated, was the worth of each man as rated, not by an 
ideal omniscient judge, but; by his all too human associates. For scientific 
assessments it is accassary to determine, first of all, the range of funuicmal 
effectiveness and of general conduct that is acceptable to the adrnii\istrntors 
of the organization to be served, and, also, an account of all ilm factors 
which may operate to put a man outside the range of acccpcalnlity* ftince 
the OSS staff did not take these steps, the clescri[)tion of them will l,)c post- 
poned until Chapter X (Recommendation 2 ). 

The psychological principle underlying Seep i may be stated as follows: 
a large proportion of the determinants of the direction and efficiency of a 
person’s behavior consists of components of the environmental situation; 
therefore, the more precise and complete the definition of the environment, 
the more accurate will be the predictions of behavior. Among the chief 
components of tlic environment arc the institiuional expectations in respect 
to the role-functions which the individual has had assigned to him. 

Step 2.--0/? the basis of the preparatory analysis of jobs, list all the per- 
sonality determinants of success or failure in the performance of each job: 
and from this list select the variables to be measured by the assessment 
process. As explained earlier, the OSS staff was unable to follow this dircc- 
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rive in any thoroughgoing fashion. In the hrst place it was agreed that it was 
not possible for the assessment staff at any one station to test suitability for 
the great variety of highly technical functions embraced by the OSS (e.g. 
piloting an airplane, parachuting, translating Albanian, drawing posters 
to influence Germans, setting Japanese type, and so on) ; hcncc the measure- 
ment of such very specific factors was not included among the responsibil- 
ities of our staff. In the second place, we did not obtain sufficient informa- 
tion about the less special functions and about the conditions in the different 
theaters to enable us to discover most of the nontechnical determinants of 
success or failure. Finally, even if we had secured the required information, 
passing judgment on a candidate according to his apparent suitability for 
a specific assignment turned out, in a large proportion of cases, to be more 
or less irrelevant, since the job that was assigned to him in the theater was 
different from the one proposed for him in Washington. 

For these and other reasons it was decided at the start chat we should 
assess each man not primarily in relation to our conception, such as it was, 
of a special designated assignment, but in relation to a cluster of general 
qualifications (dispositions, abilities, traits) which were essential to the 
effective performance of almost every OSS job overseas. Before Station S 
was opened, in fact, one of the members of the staff (Lieutenant Gardner), 
by interviewing various branch chiefs and their administrative officers, ob- 
tained what seemed the next best thing to job descriptions — a list of abilities 
and qualities which these officers considered necessary for the accomplish- 
ment of the projects planned by their section, At the end of this inquiry we 
had a sizable array of requirements which could be abbreviated without 
much distortion by resolving differences in terminology and by combining 
related factors under a single term. For the first five months wc worked with 
a list of about twenty variables, some of which, as time passed, had their 
hair trimmed, their beards shaved, and their names changed. At the end of 
this period we succeeded in combining these into the following seven major 
variables (basic to the needs of OSS) : 

1) Motivation for Assignment: war morale, interest in proposed job. 

2) Energy ^ and Initiative: activity level, zest, effort, initiative, 

3) Effective Intelligence: ability to select strategic goals and the most 
efficient means of attaining them; quick practical thought — resourcefuh 
ness, originality, good judgment—in dealing with things, people, or ideas. 

4) Emotional Stability: ability to govern disturbing cmtitions, steadiness 
and endurance under pressure, snafu tolerance, freedom from neurotic 
tendencies. 

5) Social Relations: ability to get along well with other people, good 
will, team play, tact, freedom from disturbing prejudices, freedom from 
annoying traits. 
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6) Leadership: social initiacivcj ability to evoke cocjpcration, organizing 
and administering ability, acceptance of: responsibility. 

7) Security: ability to keep secrets; caution, discretion, ability to ])lafl 
and to mislead. 

Such were the general qualifications for all OSS men and women (leader- 
ship excepted hi S(»rne eases). Distinguished from these were the special 
qualifications appllcalilc for the most part to the undertakings of ouc. or two 
branches only. Of these, tlirce were added to the list (if general ciualilica- 
tions printed on the formal report sheet: 

8) Physical Ability: agility, daring, ruggedness, sfamimo 

5) Observing and Reporting: ability to observe and to rcMnctnher ac- 
curately significant facts and their relations, to evaluate information, to 
report succinctly. 

lo) Propaganda SlfiUs: ability to apperceive the psycludi^gkal vulner- 
abilities of the enemy; to devise subversive tcchnitjucs of one sort fjr an- 
other; to speak, write, or draw persuasively. 

Besides these there were a few alnlitics (Teaching Ability, Reerttiting 
Ability, for instance) which were measured in special cases anti an indefinite 
number of variables used in writing sketches of the candidates* perstuudhics, 
which were not included in (he hernial list, cither hccaiisr they were too 
specific (pertinent to a few jobs only), or because were not readily 
measurable in all candidates under the c(uuliiimis set W]^ at S and at W, 

For the last three months of its twenty months' service, the assesstuetu 
staff, besides rating the seven general variables mentirmed aliovc, assessed 
the suitability of every candidate for each cjf three locatifJiis in the (heater 
(relative to the front), for each of three levels of autluirity, and for each of 
ten job categories. This seemed to l)c the only way of partially S(dving two 
of our most vexing prcihlcms: how to record (for later evaluation) otir 
estimates of a candidate's funcss for jobs other than tlic one prt^[XJscd for 
him in Washington, and how to transmit jiulgmcnis that would help in 
the reassignment of a candidate in the theater. 

One might almost say, exaggerating a little, that in the OSS the conven- 
tional role of the administrator and the rede (»f the technical expert were 
reversed. Commonly it is an administrator who passes on the general suit-* 
ability of a candidate in respect to [icrsonal a[)pcarancc, energy, tempera- 
ment, interest in the job, likabiliiy, tael, cooperativeuess, leadership qualities, 
and so forth; and it is the personnel psychologist who classifies him accorck 
ing to his special talents. In the CXSS, on the (Jther h;uul, it was the recruit- 
ing officers and the administrative officers who decided (on the basis oi 
work history and other data) whether a candidate had the recpiircd tech- 
nical proficiency and it was the professional assessment staff that passed on 
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his general social qualifications, his mental health, and his power to abstain 
from actions which might bring discredit to the organization. 

Step Define (in words that are intelligible to the personnel officers and 
administrators of the organization") a rating scale for each of the personality 
variables on the selected list as well as for the one oaer^all loanable Job 
Fitness. The members of the OSS staff found a six-point rating scale well 
suited to their purpose: 

01234 5 

Very Low High Very 

Inferior Inferior Average Average Superior Superior 

7% 18% 25% 25% 18% 7% 

The percentages indicate the proportion of men that would fall in each 
category if the variable in question happened to be normally distributed in 
the candidate population. One of the advantages of this scale is that it can 
easily be converted into a two-point, three-point, or four-point scale, or, by 
using pluses and minuses in marking, into an eighteen-point scale (in prac- 
tice a sixteen-point scale, since the extreme ratings 0— and 5+ arc rarely 
used). By combining the lower two categories and the upper two categories, 
the six-point scale becomes a four-point scale, which, according to our ex- 
perience, is the most useful one in obtaining ratings from nonprofessionals 
(ocher members of the organization) : 

V 2 3 4 

Inferior Low Average High Average Superior 

Unsatisfactory Satisfactory Very Satisfactory Outstanding 

All this is explained at greater length in Chapter X (Recommendation 2.4 
and Recommendation 3). 

Rating variables is an exceedingly crude and abstract mode of represent- 
ing certain realities of personality; but it is a useful and defensible procedure 
notwithstanding. It serves to focus the attention of the assessors on the most 
crucial components and to force them to make repeated attempts to justify 
their ratings by recalling concrete samples of behavior. It provides a rough 
summary of a large number of judgments which assists the staff in arriving 
at a final assessment. It transmutes clinical observations into the only form 
which can be handled statistically. Finally, it constitutes a brief and in- 
telligible mode of communicating estimates and predictions to the officers 
of the institution. The errors to which abstract symbols of this sort are liable 
to give rise may be corrected to some extent by combining them with a more 
concrete personality sketch which describes the interactions of the rated 
variables and their characteristic manifestations under varying conditions. 
The unsatisfactoriness of variables that are as general and ambiguous as 
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chose used by OSS asscvssmcnt units can he reduced to some extent by list- 
ing under each heading, as we did, several more specific modes of behavior 
which may be regarded cither as components or as criteria of the variable. 
Thus under Emotional Stability vve included adaptability, maturity, steadi- 
ness under pressure, snafu tolerance, freedom from neurotic SYm[unnns, 
We made a practice of underlining on the final report sheet the subvari- 
ablcs which were considered sStrong and crossing out those which were con- 
sidered weak. 

The rating tcchnujucs employed by the CXSS staff are described in (Chapter 
V. 


Step ^.--Design n program of assessment procedures which will reveal the 
strength oj the selecied variables. 

Substep 4.1.— the assessment procedures within a social matrix com- 
posed of staff and candidates. Our cxiK'ricncc shows that it is not difficttlt 
to create an informal, sincerely genial atmosphere at the assessment station 
and that under these conditions most of the asscssecs will enji^y themselves 
and be more inclined to tolerate an exacting and stressful schedule, of pro- 
cedures than they would l>e in a less agreeable social climate; and also 
under these conditions they will be disposed to relax during the times when 
they are not engaged in assigned tasks and conduct themselves somewhat 
as they would in everyday life. Further, our experience shows that the siafT 
can acquire invaluable impressions of the candidates during these hours of 
relaxation: from a wisecrack overheard in the hall, from a heated conversa- 
tion at dinner, from the way a clique forms in the living rtx^m, from the 
gesture with which a man reacts to defeat in a game of bridge, from a break- 
{ast-table report of the sleeping behavior of one of the candidates, from 
frank comments on the testing procedures cdicitcd during a casual con- 
versation after supper, from sentiments privately expressed while taking a 
snack in the kitchen before going to bed, and so forth. When the candidates 
live and cat with the staff mennbers for two or three days, the situation has 
some of the flavor of a house party, and consequently the offering of liquor 
on the last evening comes within the range of habitual expectations and 
is not often interpreted as a stratagem to entangle the unwary. 

It is hard to get to know a man merely by c 4 iscrvuig him behave in a con- 
trolled situation. Impressions obtained at such times require complemciua- 
tion and reinforcement by others gained from numerous casual contacts at 
moments when tlic CvandicUuc is less guardedly aware that his actions arc 
under scrutiny, Also, in the process of developing a conception of the man's 
character it is advantageous to have him uiuler the same roof so that he will 
be repeatedly seen in the ordinary course of events, and can, when necessary, 
be engaged, as if off-handcdly, in conversation. 
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Furthermore, if the candidates live for several days together and suffer 
the same trials and frustrations, and together laugh at the same humorous 
incidents, the majority become ^velded, even in this short space of time, into 
a mutually sympathetic whole, and on leaving, each man— with some ex- 
ceptions, naturally— carries with him a favorable opinion of the assessment 
process which has become solidified in his mind by the consensus of the 
group. It was found, for example, that the “graduates^* of the three-day 
system at S were decidedly more enthusiastic about the merits of assessment 
than were the “graduates” of the one-day system at W, who had little chance 
to develop mutuality of feeling. Thus if it happens to be necessary to con- 
vince the members of an organization of the value of assessment procedures, 
the living-together system as practiced at Station S can be highly recom- 
mended. Finally, under “house party” conditions the candidates have numer- 
ous opportunities to size each other up, and, therefore, more reliance can 
be placed on the returns of a sociometric test which may advisedly be sched- 
uled as the last procedure on the program. 

Substep 4.2 . — Select several different types of procedures and several pro- 
cedures of the same type for estimating the strength of each variable. In 
the ideal assessment program there will be mmerous procedures for pre- 
dicting the strength of each variable, since experience has shown that no 
single test has a very high degree of validity. These procedures will be of 
different types (e.g., interview method, questionnaire method, situational 
method) because each type (method) has certain specific advantages as well 
as specific disadvantages. Some subjects are better revealed by one method, 
others by another. Finally, each method will be represented by several differ- 
ent procedures (varieties of the same method), since no one operation of 
personality can be taken as a valid index of what an individual will or can 
do in dealing with situations of a certain type. It is necessary to know the 
degree of consistency of a personality. 

At Station S, for example, the variable Social Relations (disposition and 
ability to get along with others) was revealed by six different methods: 

1) Interview. 

2) Informal observations through three-day period. 

3) Individual task situations, where the single candidate was faced by the 
necessity of dealing with one or more persons (sometimes stooges) in 
achieving his end. 

4) Group task situations, where a team of candidates was instructed 
to cooperate in performing a prescribed task, 

5) Projection tests which revealed some of the inhibited or unconscious 
social tendencies of the candidates. 

6) SocLometric questionnaire in which the candidate's acceptance or re- 
jection by his fellow candidates was estimated. 
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Furthermore, several of these methods were represented by two or three 
different procedures. For instance, there were three individual task sit- 
uations: 

3a) Construction Testy in which the candidate had to direct two recal- 
citrant *‘assistants” (stooges) in helping him to erect a wooden structure 
within a given length of time. 

3b) Rccruitin}^ Testy in which the candidate had to interview a person 
(stooge) applying for a position in a secret organi/.ati^ni. 

3c) ImprouisntionSy where two candidates luid to deal wiih each taher 
in a face-to-face situation of a prescribed character. 

The multiform method of examination docs not require ten or twelve 
times as many procedures as there arc variables, because many procedures 
yield ratings on several different factors. Almost every factor, ffjr instance, 
can be roughly estimated on the basis of an interview. Or, to take uiiothcr 
example, one questionnaire can be constructed which lists every condititai 
that is likely to l)e encountered In the field and which asks the subject to 
estimate the positive or negative appeal of each of these fnr him. 

Underlying our recommendation for the inclusi(jn of uhtny imried pro- 
cedures is the well-accepted fact that in order to formulate a personality one 
must know many of its components, and therefore, since in a single event 
only a relatively few components are exhibited, the nuu'c events of wliich 
we have accurate reports the better. Also, since a man reacts diiTcrciuly to 
different situations, we need reports of a wide variety of events in winch 
the subject has participated. As a rule, the more varied the situations, the 
more varied will be the componcnis of personality which are evoked. The 
conclusion is obvious: to arrive at a conception of the different systems and 
different resources of a maifs personality, one must discover his emotional 
responses to, and his elTcctivcncss in dealing with, different Iffnds of 
situations. 

Finally, it is necessary to ascertain how the subject reacts to various situa- 
tions of the mne \indy since no man is entirely consistent. As a rule, each 
need or system of a personality is characterized by an area of generality (a 
large number of situations which evoke similar patterns of response) and a 
few foci of specificity (a small number of situations which evoke contrast- 
ing patterns). There are some people, for example, who are generally timid 
—that is, they have a high degree of sensitivity tf) most of the different 
varieties of danger — and yet they arc fearless in certain sliuaticms which 
frighten many of their associates. Contrariwise, there arc other pcojile who 
are not sensitive to most clangers but suffer fron-i a single imense phobia, 
Thus we require several procedures to discover the consistencies and incon- 
sistencies of each reaction system of the personality. The same applies in the 
sphere of abilities. 

In an ideal assessment program the candidate’s ability to perform (or to 
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learn to perform) each of the several functions of a given role would be 
estimated separately, since it cannot be assumed that excellence in one func- 
tion is highly correlated, in a given individual, with excellence in another. 
Furthermore, since no function (disposition and ability) can be accurately 
measured by a single test, a battery of tests is required to provide a sound 
basis for predictions* 

In obtaining records of many varied proceedings of a personality, mem- 
bers of an assessment staff have three sources available: (i) the subject him- 
self, who can be encouraged to talk or to write about his past experiences; 
(2) acquaintances of the subject; (3) the assessors, who create many varied 
situations the responses to which can be observed directly. No explanation 
of all this is required; it is clear that the more one knows about a man the 
more comprehensive will be one’s understanding of his unique nature. 

If it is discovered that an increase in the number of procedures (length of 
the assessment period) is not accompanied by an increase in the amount of 
pertinent data obtained, or that an increase in the amount of pertinent 
data is not accompanied by greater accuracy and completeness of the per- 
sonality formulations, then one should suspect the intrusion of errors in 
theory or in practice. This point will be discussed in Chapter X. 

We are recommending a variety of methods, not only because each method, 
by confronting the subject with a somewhat different situation, is likely to 
evoke different components of personality, but because each method which 
merits consideration has certain unique advantages and disadvantages, and 
the disadvantages of one method may be overcome by the advantages of 
another. For instance, a method may be very economical — it can be admin- 
istered by one man to a large group of subjects at once— but the whole sit- 
uation may be artificial, unlike anything which the subjects are apt to meet 
in everyday life, and their actions may be artificially constrained to a few 
preselected categories which allow no place for typical individual patterns 
of response. Other contrasting methods present the subject with a lifelike 
situation permissive of spontaneity, but are very expensive in man-hours — 
subjects must be taken one at a time or in small groups requiring two or 
three observers. Some methods yield objective, mechanically obtained quanti- 
tative scores, but the relation between the segmental processes so measured 
and the functioning of the total personality is dubious, if not definitely in- 
significant. Other methods bring important components of personality into 
operation, but estimates of the intensity of these components are matters of 
unreliable subjective judgments. And so it goes. 

A brief list of some of the ways in which techniques may vary should be 
helpful at this point: 

r) The k}nds of components of personality that are revealed^ such as 
energy level, temperament, sentiments, knowledge, theories, needs, con- 



Principles of Assessment 37 

Crete goals, degree of intcgraticjii, ability to deal with things, with peoples 
with ideas, and so forth. 

a) The components and structure of the situation confronting the subject, 

a) Physical setting: outdoor or iiuhjt^r; open or confined space; de- 
gree of temperature and light; and so on. 

b) Nature of objects to which subject must relate his efforts: physical 
obstacles to he overcome; physical objects (materials, tools, gadgets) to be 
manipulated; human ol)jccts (interviewer, stf)oges, co aciors) kj govern or 
adjust to; symhfjls (oral or written words or concepts, pictures, itik blots, 
or other represenuuinns) and areas of symbolic reference (topics of dis- 
course and knowledge) to lie dealt with. 

c) Social structure: nuinher, roles, iy[>cs, a ml attitudes of persons en- 
gaged in the situation. 

i) Number, roles, types, and atiitudes of assessors: [ihysieal presence 
or absence of official observer (if absent, whether a recorcling device or 
system of mirrors whicli permits overhearing or overseeing is suspected); 
number of assessors (c.g., interpersonal interview or board of jnclges); 
physique, age, sex, rank, race, type of asscssor(s) (e.g., amspicuoiu or in- 
conspicuous, detached or participating, formal or informal, strict or lenient, 
friendly or unfriendly). 

ii) Number, roles, types, and attitudes of other subjects: [ircscnce or 
absence of other suhjccts; an interpersonal or group situation; a mere 
aggregate (c.g., sitting at separate desks) or a reciprocating or coltabnnn- 
ing groii[); physicpic, age, sex, rank, race, ty(>c of other subjects; attiturle of 
others (c.g., friendly or not, helpful not, critical or not). 

d) Expectations of assessor (s) as understood by subject: number of 
directions (rules) or no directions; degree of constraint of directions (e.g., 
formal or informal, strict or lenient, definite or ambiguous). The assessor 
says or seems to say (according as subject interprets hts aim) one, two, or 
all of three thing.s: ’'Show me how much you know'' or how well you can 
do thiV (performance test), or "Let me see how you react (emotionally 
or directionally) to this situation" (reaction .study), or "Tell me nil (or all 
I want to know) about yourstdf" (self-communicativc situation). 

c) Degree of situational control exercised by assessor{s) : extent to which 
the situation is made to conform to an inflexible, uniform, prearranged 
pattern (c.g., an entirely uncontmIle<l natural situation at one extreme anfi, 
at the other, a situation in which all variatiles arc kept constant). 

3) The method of recording subjects behavior. Reliance may he jilaccd 
on the assessor’s unaided nliservation and memory, or recording aids (e.g., 
motion-picture camera with sound track) may be employed, la a great many 
procedures the subject records his rcs[)onscs on a paper form; in others his 
responses arc recorded mechanically (c.g., psychogalvanomcter). 
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Clinical psychology and psychiatry have yet to reach their tuH growii 
No methods are entirely satisfactory. There mu.st he constant jxj>cr:meD^ 
tion. Since it is too early to limit a program of a.ssc.'ismcnr t< » n • - 'vr-.. numk! 
of procedures, space should be left open for new technieiiics. ^ ^ 

For a short over-all assessment the interview is prolmhly the 
indispensable method we have, but many others arc very ii'=crnl •• jntelligcnj. 
tests (Bellevue-Wechsler, Mechanical Comprehension, anel Mt.icrs.), prejt,. 
tive tests (Rorschach, TAT, Sentence Com[ileti()n, for . tiactor,. 

naires (e.g., psychosomatic inventory, attitude .scales, Study <>f v ,!hsc% 
nesota Multiphasic), autobiography (or filling our a per.stuiai Vristney fonii), 
informal observations of behavior, and .siuuuional tests, c .he' la^att 

not well known and need to have attention called tn them, vvr :,«rc nukttj 
a separate recommendation in their behalf, 

Substep Include in the program a number of sitffoSfOtial iesfs k 
which the candidate is required to function at the same let ‘el iniegn^ 
and under somewhat similar conditions as he will he expeeferd (o fiitulk^ 
under in the field. This is based on the principle of ctinsi^tcncy 1 the nw 
fundamental of scientific assumptioas), which .states that rlrr ititcrattjK! 
that occur in two identical situaiion.s will he itlcntical. or st’CcifiaE; 

that a given subject will respond to similar environment. rl M’.nalions iai 
similar manner. Of course we knosv that tire pcr.sonality of orjr man at ns; 
different times is never the same, and that one can rarely say that ft: 
situations are identical, and finally that there seems to l>c force (whs 
might be called the need for novelty) in some people that pr» ‘inpss ihcnir, 
act differently from the way they did before "just for a Antiik. 

as far as assessment is concerned, it i.s not possible to prrtVu’f the formf'! 
the scores of situations a candidate will encounter in the ftirnrr ; mnsctjutBii 
strict conformity to the .scientific ideal is out of the quest son. The Iwste 
can be done— and this is a good deal — i,'; to expose .a nittn to a rmetf" 
situations of the same type as those he will meet in the field and, al'owit! 
for certain expected developments in his pcr.sonality tlnrliu: the corag 
months, predict future performance level on the assumpth'ut of amsiw 
All we are affirming here is that the “real" te.st of a fortth til player isplir 
ing in a real football game, or, if you chon.se, in a season ttf f<K!ib.all gam: 
and therefore the best way to a.ssess a football player is m oonfrnnC him will 
the necessity of playing in a simulated football game which inclutlets 
many components of a real game as possible. This assumpit- *», a comn» 
place to laymen, is not without novelty in the field of psychf»lugi«Ml ICJUaj 
It is fundamental, however, to the organismic methof! as clisringuishtaite 
the widely accepted elcmentalistic method of assessment''”' ^ stntc rncftt wK 
calU for an explanation. 

The organismic method of assessment is based on the fact that beh» 
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of the highest order of effectiveness depends on (i) the inclividuars ability 
to perceive and interpret properly the whole situation that confronts him 
(e.g.j to distinguish the major and minor dctcrminancSj to omit nothing that 
is critically important, to predict the probable course of events if he does 
not intervene) and (2) his ability to coordinate his acts and direct them in 
proper sequence toward the proper objects (to visualize the end that will 
appease his needs, to see the shortest pathways to this end and tlie agencies 
that arc available to him, and to order the spatio-temporal sequence of his 
actions, and so on) in such a way that a satisfying effect will he produced. 
Ordinarily the majority of these processes occur automatically, many of them 
unconsciously, but, in any event, they all require orgimization: the organiza- 
tion of successive perceptions into a rough schema of the developing event; 
the organization of images, words, and concepts in relation to this schema 
to constitute its diagnosis and prognosis; the organization of this prognosis 
in relation to a visualized purpose (images of a desired modification); the 
organization of actoncs (muscles and words) and of agencies (instruments 
and fellow workers); the organization of these means in relation to the 
environmental objects that must be adjusted to, interested, r>r controlled; 
and then, finally, the organization of these partial or subordinate aims in 
relation to the visualized purpose. The cQ'cctivencss of tlie whole action 
depends on the integration (internal coherence) of the constituent operations 
in the brain and on the adjustment (congruent applicatum) of tlicse 
operations to successive parts of the cnvironmciu. Consequently, in devising 
tests of ellectivencss the organismic ps'ycliologLst will choose tasks and situa- 
tions which cannot be properly solved without organization, since it is the 
power to organize, as much as any other power, that he wishes to measure. 

The clementalistlc approach, on the other hand, calls for an analysis of a 
proposed function into its component uperations and then the invention 
and standardization of one or more tests for each operation. Some of these 
tests can be administered to many subjects at once, others must be adminisS- 
tered individually. 

The elementalistic method is abstract and unrealistic, since no attempt is 
made to reproduce the conditions under which the man will eventually per- 
form. It is scientific, however, in the sense that each test measures the good- 
ness and speed of a well-defined process in objective quantitative terms, thus 
eliminating from the scoring the all too frequent errors inherent in sub- 
jective judgments. In adopting this method, however, the psychologist makes 
a radical subjective judgment at the very start by electing to abstract Cnini a 
complex configurated process a few elementary constituent processes, test- 
ing for these separately, and then adding the scores to arrive at a final rating. 
He does this even though he knows that in actual life the mind docs not add 
sequences of elementary processes to produce results, but organizes them 
into effective forms. 
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The organismic method depends for its SLica’ss upon fht .dni.iy nt 
psychologist to observe the pattern and elleciivencss of the t andid.iic iir 
havior and to identify the factors which promote and llie iaaois v.hi.ii nn 
pede the forward course of the action. And so it could be s.iui {test u\r. 
method calls for the improvement of die psychologist as (jhsctver ami in- 
terpreter rather than the improvement of mechanical instrunumts and 
materials. Because of the well-known unreliability of individual judginritf., 
the organismic method as it stands today rcquire.s two or diier .ompfoin 
observers for each event. Thus it is much more c.vpcnsive m rrspr,! m ntnr 
and personnel than elementalistic tests, many of which .ur suitaMr lot 
large groups. 

Leaving aside the great factor of nioiivation ami auisitlcriu^i' nnly thr 
nature of good thinking—the over-all importance .md < t 

imagination — and the conditions under which it nui^t ruJuunuy r?' 
in contact with men and under stress, it must be clear that an 
intelligence test could not possibly be an adequate measure oi in- 

tellection, even of abstract intellection, in an atiuk rnernher nt fa<uir?y. 
the intelligence test certainly can do is to distinguish thnsc l.uk uir 
pieces with which to build the whole, who are incapable fsf die paru.4 
prehensions that are necessary for a total act of cornprehruM an In i! ana 
this efficiently, the classic intelligence test has proved ilsrlf a m'U/, 

ment and deserves to be retained. But it h nrccss.iry to jr* 

tions since great injustice can be done lo individuals if ihc test ss n-'-'d .Of a 
criterion of thinking capacity among those whose genres r^ngr .d? .r j 
certain level. 

The striking and impressive feature of all elcmcntalisck r. lu.ii 

they provide quantitative objective measures of relatively p? , 

and thus seem to conform to the great tradition of science. An rlrmro’-iVh. 
testing program can be made into a scries of alnuist meclnuiha! 
which can be conducted for the most part by technicians pujr an 5 on;-; ir 
and the psychologist as observer, interpreter, cliagnosiiciati, .nu! valuatM^ r. 
all but eliminated. Everyone who scores the tests gets [nccisrly nhr MJur 
fesult and this gives rise to a general feeling of satisfactiMU, a iVrhtn! 
“truth,"' since consensus among experts is the nearest wc iM\ ever r*. 
justified certainty. But suppose a biologist comes along and uy*;i 
men, I am impressed by the unanimity of your judgiiiersu. I can r-cr 
evidence of subjective bias in your readings, scorijigs, and uunpounorr.. 
But on the other hand, it seems to me that suhjmivc bias iigni rd po^n 
inently in your decision to separate out one fraction of the u.mi4r% 

event and accept the measurement of this as a proper Mc\ u( the 
process. There, at the very start, is where the pmnnal clnnrtu thr Mnii 
and the sentiment— entered into your procedure. As I ^cc it, fw.di/anwii 
is an example of what Whitehead calls 'misplaced amcMcnm: Avtiudly 
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the score that you liavc obtained on this test is not a representation of reality 
—any more than the measurement of one muscle contraction is an adequate 
representation of the form and effectiveness of a complete bodily movement, 
the act> let us say, of driving a golf ball,’* This judgment, it seems to us, 
cannot be gainsaid. The subjectivity- of the clcmentalist comes in at the 
beginning wl^en he plans his procedure, and at the very end when, despite 
protestations to the contrary, he is inclined to rely on his test as a valid 
measure of over-all ability. 

The clcmcrualistic approach calls for accurate quantitative measurements 
of partial, Isolated proccssCvS, whereas the organisnaic approach comes clown 
to \ma:\mtc estimations of total integrated processes, From a practical 
standpoint the question is, Which method has a higher predictive validity? 
At the moment this cpiestion cannot be answered, no adequate researches 
hearing on this point having been reported. The result of an investiga- 
tkm along these lines will depend in large measure on which areas of 
personality arc chosen for study, on the suitability of the elcmentalistic tests 
that arc selected, and on the ability of the organismic psychologists who act 
as (ibservers. At present the great advantages of elementallstic methods arc 
fj) that they can he administered by almost anyone after a short training 
[>erind; (a) that many of them can be presented to a large group at one 
time or to individuals in rapid succession, and hence are suitable for mass 
testing; (0 that they arc generally successful in picking out those who arc 
entirely unqualified for a certain task, or those who have some definite de- 
fect; and (* 1 ) that subjective bins does not enter into the scoring of the re- 
sults. Furtlicrmore, clemcntalists can point to positive correlations in a large 
number of stiulics to prove the cflcctivencss of their methods, whereas 
organicists have as yet nothing definite to show for their theories. 

The differences between clemcntnlistic and organismic methodology have 
been magnified in this section in order to clarify the theoretical ground on 
which situational tests arc founded. The OSS assessment staffs were faced 
l)y the problem of discriminating between candidates who fell, for the most 
part, in the upper half of the distribution curve of general competence or of 
some special skill, men who had been recruited because of demonstrated 
ability in some particular field of endeavor. Consequently, elcmentalistic 
tests which had proved v;ilid in testing children and in distinguishing adults 
at the lower end of the distribution curve, but not in accurately predicting 
different degrees of excellence among adults in the upper brackets, could not 
be counted on to carry the whole burden of answering the questions that 
were asked of us. Therefore we added prrjccdures of a different kind, 
tasks which required mental operations on a hlgluT integrative level; and 
since there is a difference l-jctwcen “know-how” and “can-do”— the two 
are not always corrclntcfb-vve made the candidates actually attempt the 
tasks witii their muscles or spoken words, rather than merely indicate on 
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paper how the tasks could be done. Wc were prompted to introduce realty 
tic tests of ability by such findings as this; that men who earn a high score 
in Mechanical Comprehension, a paper-and-pencil test, may be below average 
when it comes to solving mechanical problems with their liands. fiurtiicr- 
more, because a great deal of the work of the world must l>e accomplished 
in a social context and also because the OSS staff was cxpcctcci to cMimm 
every candidate’s disposition and aptitude for harmonious social rclatiouv 
a good many of the tasks which we devised for the candidates hati to l>r 
accomplished in collaboration with others. Finally, since most of the critical 
situations which were confronting the majority of OSS men in she field 
were both novel and stressful, we made our resting situatimis novel and 
stressful. Thus it may be said that the situational tests used at OSS 
ment stations were as lifelike as circumstances permitted, incor[K)r;uing some 
of the major components of situations that would naturally ari«ic in the 
course of operations in the field. In other words, wc tried to dcdgii 
ment situations that would be somewhat similar to the .situadon’^ in (he 
management of which candidates would be judged by their suj^’iinr ofiiccfs 
and associates in the theater. 

In retrospect it seems a little peculiar that for thirty years we |nycIln|ngi^r^ 
should have devoted so much time to improving the reliability of our 
and so little time to improving their validity. Even more peculiar is fhe 
almost exclusive attention to paper-and-pcncil tests when the results studies 
of the reliability of these tests were all painting tf> the irnpurt.mcc of the 
principle of similarity— similar situation, similar response. Time and tunc 
again test constructors have found that to olnain a high coi’rriaiion hruvern 
two tests of the same function, the forms of the tests must l^c very MUiilar, 
For some reason, however, the principle of similarity has rarely hrm applied 
to the primary task of test invention. Few people seem cu have (ktu at all 
disquieted by the fact that taking a conventional paper-and pencil test ii 
very different from solving a problem in everyday life. Finally^ as previrnndy 
stated, all of us have been lax in bringing our critical reflections and tri in 
niques to bear on the crucial task of validation. Surely, the cwtiti.d cricerinn 
of a good test is its congruence with reality; its coherence wiih other tesss is 
a matter of secondary concern. At this stage, in fact, the problem of validity 
is so important that wc would suggest a reversal of the usvinl procrdujr: thM 
tests which are being developed should be administered only to persons who 
have been thoroughly studied, persons about whose activities sufikicni dam 
have already been collected. 

Situational tests have a long and honorable fKrdigrcc that reaih^s Uuk 
into Biblical times, and if American psychfdogists were as phuH us tlir 
early settlers of their country they would undoubtedly have nune iqw.rt ilw 
records of these ancient experiments and recast them iiuo itunlern forms. 
It was none other than Jehovah who improvised the first large-scale 
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situational test) the object being to provide Gideon with a reliable basis 
for [lickijig the best warriors from among ten thousand volunteers. 

And the Lord said unto Gideon, The people arc yet too many; bring them 
down unto the water, arid I will try them for thee there: and it shall that 
of whom I say unto thee, This shall go with thee, the same shall go with thee; 
and of wlioin soever I say unto thee, This shall not go with thee, the same shall 
not go* So he brought down the people unto the water: and the Lord said 
unto Gideon, Everyone that lappeth of the water with his tongue, as a dog 
lappeth, him sluilt ihou set by himself; likewise every one that boweth down 
upon his knees to drink. And the number of them that lapped, putting their 
haiul to their mouth, were three hundred men; but all the rest of die people 
bowed down upon their knees to drink water. And the Lord said unto Gidcoii) 
By the three liuiuired men that lapped will I save you, and deliver the Midianites 
into thine hand: and let all the other people go every man unto his place. 
(Judges 7: 4-7) 

As prcKjf (iC the efficacy of this tCvSt is the recorded fact that the three hun- 
dred put to rout the host of Miclian, drove them across the Jordan and out 
f)f the land of Israel . There wins no mcnllon of cowards among the three 
hundred) who even while drinking had remained alertly aware of the possi- 
liility of being attacked by ilic enemy. 

Step ^y--Construct a sufjicicnt lormulution of the personality of each 
lissessec before specific ratings, predictions, and recommenda- 

tions, This is the second of the two major technical principles of the 
fu’ganismic system of assessment. Like the first major principle (Sul)step 
.p:}), it is derived from the general proposition that the whole and its parts 
are mutually dependent. If this is true— and, today, who doubts it?— it fol- 
lows that to explain or to predict the manifesiccl pares of a personality 
in a .s|X!cificd sitvnuioti one must discover the nature of the personality 
as 11 whole. Alll\f)Ugh the expression “personality as a whole” has become 
fashionable in certain professional circles, it has never been precisely defined 
and the best we can do, as we proceed, is to explain what we mean by it in 
the context of this section. 

Let us start by placing personality in space. Where is it? The processes 
and integrations of processes which constitute personality occur in the brain. 
This is the scat of the government of the organism, since it is the only 
[)Iacc where sensory processes from the entire body terminate and motor 
processes to ilie entire body originate. It is the locus of the feelings which 
evaluate events as they occur and cli.scriminate goals for action. It is the 
.seat of consciousness, of thought, of conflict, and of decision. It is also the 
re|X)sitory of all traces of past experiences, of percepts, symbols, concepts, 
values, emotional attachments, commitments, plans, resolutions, and anticipa- 
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tions. Thus the enduring latent establisluncnts as well as tlu: kiiu'tie jn.uossr.s 

of personality are in the head. ^ 

Next, let us place personality in time. What is tlie duraumi i>l personality r 
Personality is a developing “institution” which functions from hiith m 
death. During sleep, unconscious anabolic proces-ses regenerate the souhcs 
of the energies that are expended in the ceaseless tutivities sshsiii toii'.ijitn-'' 
its waking life. The history of a personality might Ik irprcscnicd .is .1 hatg 
sequence of proceedings. Some of thc.se .arc intenud prweeJings' dm mg 
which the personality, abstracted from its envininmeni, is d.sydteaming, or 
attempting to understand and evaluate past events, or to prcliu. the fitnitr, 
or to assess its own capacities, or to settle some conflict, or to ••■-Ur -...iiir 
intellectual problem, or to lay out a course of action, or to ilrcidp svhat to 
say on an anticipated occasion. Others arc externd prmecJi/tgs fltttin-; 
which the personality is overtly engaged in dealing with its cnviiKiitumt. 
in observing, enjoying, manipulating, complying witlt, ik'lVndmg iiscis 
against, or avoiding, other personalities or pii)',sical objects. Tvery pn.t red- 
ing leaves behind it some traces of its occurrence, traces 0/ its novel rlrmenf, 
especially. In this manner the more or less enduring cftahUdtmcnrt oi per 
sonality— its supplies of facts, concepts, values, action-p.ntcrin ,»rr rxtrijiird 
and modified from day to day by the results of its fuiniion.il opri.itsc.tv. 
Most personalities are developing along certain lines by ,i'-'.itsui.itjiiii'. 
differentiations, and integrations— throughout life, although m other trspr. !>. 
they may be merely conserving what they have, acquired, or jrih.ips tosuig 
it regressivcly. Anyhow, the establishments of per, sonality, t o-ss \ri tiOMily 
considered at different points in its life history, arc tliiferrnt. 

Since we cannot observe the establishments rif personaiiiy in liie iti.nn, 
and we have no instruments capable of directly recording in, fiiti. !i>'ii.(! 
processes, and, since it has been shown that not all thc.se pmeesses h,tvr the 
property of consciousness, it is evident that the ctimiHinents ami stitii tnrr'- 
of personality must be inferred from their manifestations itj the sirrutii of 
consciousness and from their manifestations in the (low of ovett sprcih .md 
action. The data consist of subjective facts rc[)orted liy the individtial .tisd of 
objective facts observed by the psychologist or by others, Wiili ihr.sc in tiitiid 
the psychologist attempts to arrive at a conception of the forms of t!ic 
determining variables. Thus the personality is not a series of jKiarpSitiie 
facts, but, in actual practice, a hypothetical formulation, the aim of whiih 
is to explain and to predict the perceptible facts. 

Another point which must be held firmly in niintl i,t (hat in :tii.ihviiig 
and reconstructing each of the significant external [irocccding’s of personality, 
it is as necessary to define the structure of the environmental sitiiaiion, (hr 
attitudes and actions of the object, as it is to define the .iuituilr.s ami ai iioris 
of the subject. One must not represent a personality as if it existed in a vac 
uum. Its establishments must be connected with the objects and sitnaiionv 
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whith cvokr flinn, 'I hi-, is [aiuailarly true in formulating the develop- 
ing M‘rirs tif }')!>'«, rrdiui;;., rsr the saini whirl) consritutes the history of an 
interpersonal relationship, a fsiriulship, or marriage; the representation o£ 
tl)C person, iluy of tlic ohicd is essential to an understanding of the subject, 

In ntlitr words, akhtaip/n the processes of [sersonality occur in the brain, 
they eannot l>c desi.rshcfl or aplained without reference to external objects 
and settings, Clonsrqurntly, tha environment is included in every adequate 
fmnudiUion of frrmmiits\ 

NoWr perhaps, wc iirr in a pisition to consitler the meaning of ‘'whole*’ 
as :i[?plirc} to personality, *Sfi;ne [k:o[i1c use “vsdiolc [icrsonalicy” compre- 
hensively Oi drtn tc tlse total or emiic pcisniiality. Here there are two 
(Kissihiliticst fhr vvholr longhudinah or fcni[)oral, [icrsonality, and the whole 
ensss sectional peroinaiity. The former is relatively concrete and referential: 
pmtnjnlify U the entire sequence of rirgunimi psychological processes in 
the tyrain from birth to death, The cross-sectional rkfinition, on the other 
hantl, is vay alisrract and hyi'Kithctical; [lersonality is tlic entire constitu- 
tion of potential psjs hologkal proccssc.s ai\d structures in the brain at a 
given rimrtirfU. This iancr definition clcprnds on a morphological supposi- 
tion inasimah as ii assumes the existence or .some more or less enduring 
physkoclirmkal struemrrs, <»r cstahlishmenls of personality, which remain 
dormant except svhen activated by certain siinuili. The establishments, how- 
ever, arc never descrificd iti morphological terms, but rather as they arc 
fihjeciificd in irmjKual patterns of activity. These two conceptions of the 
“witole [>crMJnahry" might be combined into an all-inckisivc notion which 
embraces n(»t only the history of the [uoccedings of personality (longi- 
tudinal view), but the history of its developing tsstahlishmcnts as portrayed 
by a series of cros^, sectional formulations. 

TItc iKXt point U> be noted is that a complete fornuikuion of the tvhoh 
persmndity, longitudinal or cross sectional, i.s not. only far beyond the powers 
of any group of [)sycholf)gists today, I nil, if uchicvalde, would be much ton 
long and crmiplirated for ordinary use, Consequently, wc speak of a suffix 
dent formulation, meaning sufficient for a designated purfwse, which, in 
the present ease, is the assessment of men and women. Inasmuch as a com- 
plete formulathm is both im[>ossible and undesirable, the term “formula- 
tion’’ can be used to denr^te a “sufficient formulation.” Since a formulation 
that is sufficient for one pur[K)sc--say, assessment— will not usually be suffi- 
cient for another- "say* psychotherapy— there may be several different formu- 
lations of the same personality, all of which arc correct. But, as we see it, 
every formulation should give an outline, not of the “whole personality,** 
but of the “personality as a whole.” 

“Personality as a whole” does not mean the whole, entire personality; it 
means the ovcr-all unity and organi7.ation of parts that is attained during 
a designated period of the subject’s life. It refers to the degree of unity 
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and coordination (wholeness) that the personality exhibits durinj^ f.uie .short 
functional operation, or in a long scries of progrc.ssions, day after day, 
toward a distal goal, or in the establishment, over a lifeiiinc, of a hannoninns 
way of Hfe which allows for the successive satisfaction oi its major needs. 
Whatever the degree of unity that is achieved, it comes out of cMndufs 
and resolutions of conflicts; and these should be included in the. foumtl.u ion. 
This conception of the “personality as a whole' points to a goal dneririi 
force, or conation, as the chief unifying and intcgraiing factor in person- 
ality. Psychologists are not yet agreed as to the [)rn[>(:r rc(>rcsrnt,uion of 
the basic determinants of effective actioit, hut universal human ex[>rrierue 
teaches us that it is emotional, intellectual, and conativc energy direrted 
toward a defined purpose which organizes the psychfjlogical prorc'^scs iiuo 
a temporal whole. This is the outstanding conscious fact, regardless of the 
number and nature of the underlying needs or drives which will be .'^ppca^Cil 
by the action. An extreme case of wholeness would he a [>crMm;di?y ?h.u 
is completely controlled by one pcrsistiiig, sinwordlnatc, long-range pur[i^»v\ 
The definition of this purpose would be enough to explain mrva the 
functional operations. Since in actual life one never finds a prrsnu.dity 
so unified, the representation of “wholeness" is okut complicarrd. It 
usually comes down to a formulation of the relations htlwcrn thr nufiof' 
dynamic systems, each of which consist.s of a combinarion of nceiis dirrrt^^d 
toward a combination of goals, and, integrated with these, one f»r more 
valued goal objects and goal places, and a large mnnt>cr of juUMn [suirtn'^ 
and agencies. The degree of elfcctivcness of each dynamic syarm ^hoiihl 
be included in the account. 

Beside vectorial forces there are a number of other variables which havr 
a broadly determining, and so, in a sense, unifying, iafluriKT rni ihr jirr- 
sonality. Among these are energy level, temperament, suhjcctivity'ohir.t tivity. 
introversion-extraversion, egocentricity-socioccntricity, confi^rmiiyuioiHon- 
formity, and so forth. But we arc not going to discuss the [ifoblcrn of what 
variables are required for a sufficient formulation of persEinaliiy, fu'sc, hr 
cause there is no possibility of doing justice to the .subject in the .sp.u'c 
allotted, and, second, because we abandoned the plan of actem[iting to set 
forth the products of our theoretical reflections, fearing, as cxplaincrl in the 
first part of this chapter, that no ^statement would confi'>rm to tlie views nf 
the majority of the .members of our staff. 

Up to now no proposed definition of personality has [proved satisfactnry 
to all schools of psychology, and there has been no unatiimiry ns to how emr 
should go about formulating the events of a person's life iar (utrjKKr^i o{ 
explanation, prediction, and control. There arc no available holisiic contTp; 
tions for representing normal personalities. But the psychologi.u is nor vvirl^ 
out instruments of thought. He posscs.ses, in fact, n large nutnher of fairly 
well-defined concepts which stand for (i) certain hypothetical structure.^ of 
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the personality (e.g., ego, superego, ideal ego); (2) certain hypothetical 
components (e.g., intericjriiy complex, sentiment pro underprivileged, agora- 
phobia, need tor sii[)port, [ujlitical orientation); (3) certain modes of feeh 
ing, thought and uctiru) (c.g., cycloid temperament, objectivity, flight of 
ideas, impulsivity) ; (4) certain kinds of eflcctiveiicss (c.g., general intelli- 
gence, mechanical ability) ; and also (5) certain disease entities (c.g., com- 
pulsion ncurtjsis, schizophrenia). d‘ho killer might be considered holistic 
f(»rmulations in so far as cacli of them delines a rather large number of 
in ter cor re la ted variables and (for each disease) the general structure of 
their ijitcraciioms. ] 5 uc the coinpound L'ojice[)t of each disease reconstructs 
a certain variety of disturbance (conflict, dissociation, and so on) which 
rjcciirs within a total personality. I'hc cllective heaUh-producing processes 
of the personality, which vary from case to case, are not included in the 
formulation. 

Besides concepts of thivS sort, there arc excellent descriptions in the litera- 
ture of rudimentary tyi^ologies based on a few variables, usually a dichotomy 
(c.g,, subjective-objective, introversivc-extratensive) or a trichotomy (c.g., 
narcistic, ob.scssive, and erotic). But all of these require further analysis in 
conjunction with siudics of other variables. To identify a man as an introvert, 
for exani[)lc, gives us no information as to his energy level, his fluctuations 
of mood, his enduring emotional attachments, his membership systems, 
his political ideology, the pattern of his erotic fantasies, the strength of his 
conscience, his major dilemmas, his intelligence, his Initiative and resource- 
fulness, the degree of his .self-confidcnce, Ins dominant aims, tlie level of his 
aspiration, his chief ahiliiies, and a great many other important components, 
Psychiati’ists and j)sychologists arc just now in the process of Identifying 
and defining these separable variables. I'hcy liave not reached the point of 
altcmpting to combine a sunicient number of tliem into tentative formu- 
lations susceptible of verification by detailed personality siudics. It is worthy 
of note that very many of die concepts which arc commonly used today in 
formulating personalities have been coniribuLcd by psychoanalysts and psy- 
chiatrists who arc inclined, partly by the demands of their profession, to an 
organismlc frame of reference. 

We shall make no attempt to list the notions which were most commonly 
employed in attcnqiting to represent the personalities of the candidates at 
assessment. Since there was no time to construct a common conceptual 
.scheme, each senior staff member whose duty It was to write personality 
sketches used the concepts wliich he consiclcrccl most adequate in portraying 
to iiimsclf ami to his fellow workers the underlying dynamics, Since the 
sketches were composed for laymen (ihc administrative officers of the OSS), 
they were not written in abstract terms, hut on the level of ordinary dis- 
course. These sketches were the only records that were made of the results 
of holistic reflections, and so it is not possililc now to state how far toward 
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"wholeness'' the stall members carried their conceptualizations of the cliflcr- 
ent personalities. The process which took place in their heads is not on 
paper. Certainly most of us never approximated the ideal: a formulation of 
the “personality as a whole." This expression, consequently, must be under- 
stood as a somewhat pretentious overstatement. But current usage provides 
no other term to distinguish our attempt from the elementalistic mode of 
procedure. 

Here it is perhaps worth pointing out that the task of a present-day 
clinical student of psychology is that of an explorer and experimenter rather 
than that of a diagnostician. To make this plain we might consider a greatly 
oversimplified statement of the problem in the form of an analogy. Take 
the case of the organic chemist whose function is to predict the behavior 
of a sample of any compound that is handed to him. What will he do? 
He will note its physical properties and then observe its reactions to a num- 
ber of known substances. The results of a few tests of this sort will usually 
enable him to name the substance and then to predict immediately the 
processes which will ensue when it is confronted by this and that com- 
pound under specified conditions. Now, one reason, among several, why the 
predictions of the chemist are highly valid is the fact that the properties of 
most of the objects with which he deals have been thoroughly studied, and 
so his routine task is that of distinguishing (naming) an entity about 
which there is a mass of ordered knowledge summarized in manuals and 
textbooks, rather than that of discovering the nature of an entity about 
which little or nothing is known. (The latter is the task of an experimental 
chemist.) Here it should be noted that knowledge about a compound is 
mostly contained in statements as to its chemical properties, that is, in rep- 
resentations of the nature and effect of its reactions with other l{nown 
compounds under \nown conditions, In other words, to know (understand, 
formulate) a compound in “functional" terms, one must possess an equal 
amount of knowledge about (i) each of the different entities with which it 
reacts, (2) the product of each reaction, and (3) the setting in which the 
reaction occurs. One thing is defined in relation to each of a tuimbcr of 
other things. Since about three hundred thousand compounds have been 
defined, the population of entities within the modern chemist's empire in- 
cludes a great many “knowns"; and as soon as he has identified (named) one 
of them, he is prepared, with the manual at his side, to predict its behavior 
in the presence of each of a large number of others. The naturalist, with 
his definitions of thousands of different species, and the physician, with 
his Integrated mental representations of scores of different ailments, arc in 
a similar position, in so far as each is able to make a number of reasonably 
valid predictions (prognoses) as soon as he has correctly discriminated 
the entity before him. He can do this because, like the chemist, he has at 
his disposal a mass of scientific information— collected, sifted, correlated, 
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and ordered by gcneraLioiis of workers — ab(jut most of the entities which 
belong within his province. 

Now, for the moment, let ns imagine a state of alTairs which would 
enable a psychologist to function as docs the chemist, the naturalist, and the 
physician. Let us suppose that the most fundamental and most crucial 
variables of personality have already been discovered, and, for simplicity's 
sake, say that these variables arc dynamic systems, each of which in- 
volves a pattern of specified actions in relation to a pattern of specified 
situations. Let us suppose that millions of people have l)cen thoroughly 
studied and it has been found that they fall into one thousand Ly[)es, 
each of which has been properly defined and named. Let "definition of a 
type” be equivalent to "formulation of the personality as a whole.” Since in 
the process of arriving at the different types (the thousand different con- 
ceptions), minor variables (slight differences in form and numerous in- 
significant elements) were necessarily disregarded, a formulation will not 
represent the "whole” (entire, complete) personality of a man, hut his 
personality "as a whole”; that is, the organization of the dominant acthiii 
systems. Let us further suppose that the lives of one hundred IndlviduaLs 
corresponding to each of the thousand types have been exhaustively studlctl 
and there is now available a great deal of ordered knowledge about the 
behavioral variations within each type. According to this fantasy the psy- 
chologist is now in the position of a chemist, naturalist, or pliysician. His 
task is CO make a diagnosis, to idcniify the type, to recognize an entity about 
which much is known, Since to accomplish tliis, a few tests will often be 
sufficient, it could be said that this fictitious professional, by discovering 
a little about a man, can suddenly know a lot— everything that has been 
written about the given type, With this knowledge lie is able to predict 
with a reasonable degree of accuracy how lie is likely to react and witli 
what effect in this and that situation. 

All this, of course, is a wish-fulfilling fairy talc. For no satisfactory 
formulation of a personality as a whole has ever been published. None of m 
knows exactly what efements should be included, or how the various inter- 
relationships, or patterns, of these elements should be represented. At present 
the psychologist is more in the position of a chemist who encounters an 
entirely new and different compound, except that he is not acquainted 
with all the elements that could possibly exist in the object of his interest, 
and he i$ not familiar with the consequences of different possible com- 
binations of the elements with which he is acquainted. His task is not one 
of recognizing an old acquaintance (apperception), but of discovering the 
nature of a stranger (conceptualization). 

We have violently oversimplified the contrasting situations of chemist and 
psychologist in the hope of clarifying the latter's job and of Indicating 
a strategic course for research and reflection, namely, the development of a 
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typology which incorporates a sufficient number of variables, Since the 
formulation of a type must be based on an understanding of the mode of 
organization of variables, the undertaking calls for an organismic, or 
holistic, approach. This is another reason why we are not enthusiastic 
about the elementalistic method of testing when dissociated from the study 
of each person functioning as a unit. The elementalistic statistical mode of 
advance may succeed in telling us what variables are commonly combined 
in one person, but, as yet, it cannot reveal the form in which they are 
combined. 

At this stage in the development of our science, each conception of a 
personality is a compound of inferences, a product of the imagination, which 
must be verified by observations of behavior in the future, It is a conception 
which might be compared to a model of an extinct type of man constructed 
by a paleontologist, except that the paleontologist, having learned a good 
deal about the evolution of the human skeleton, is probably justified in 
making his rough reconstruction of the never observed whole body of a 
primitive man on the basis of one or two fragments— an unearthed jaw- 
bone, or even a single tooth. But if no entire human skeleton had ever 
been studied, the discovery of a few pieces of bone could hardly lead to a 
valid inference as to the total structure. One could not even "understand*’ 
the pieces. It would be necessary to collect a great many more fragments 
in order to build a rough model of the whole, and only then would 
it be possible to perceive the relations, and hence the meaning and sig- 
nificance, of the initially discovered parts. 

This illustrates in a crude way one of the chief purposes of a conception 
of the whole: it provides ground for a reinterpretation and rc-evaluation 
of the manifested parts, the very parts which led to the conception, An- 
other analogy, though static, might serve to clarify this point. Suppose 
you were given only twenty (out of a total of two hundred) pieces of a 
jigsaw picture puzzle. If you tried to guess the meaning of each of these 
pieces isolated from the others, you might conclude that a particular light 
blue piece, for example, was a fragment of sky because 8o per cent of all 
light blue pieces in one thousand puzzles studied represented sky. But, 
on the other hand, if you examined all twenty pieces in relation to each 
other, it might become apparent that the light blue piece was probably 
not sky at all, but part of a woman’s dress, since there was another piece 
which showed a light blue sleeve reaching to the wrist of a delicate 
bejeweled hand. Furthermore, several other pieces might clearly indicate 
that you were dealing with an indoor rather than an outdoor scene. 
Finally, if the twenty selected pieces came from critical areas of the picture, 
it might be possible for you to draw a rough hypothetical sketch of die 
whole design, many details being necessarily omitted. This hypothetical 
picture-as-a-whole would be analogous to one of the several meanings of the 
term “personality-as-a-whole.” 



51 


Principles of Assessment 

The method we are supporting here is that of predicting the future by 
thinking inductively from an observed set of facts to a conception (a 
hypothetical formulation of the personality), and then by thinking de- 
ductively from this conception to the facts which should be expected. In 
contrast to this is the practice, common among those using testing techniques 
today, of predicting the future by proceeding mechanically from the ob- 
served facts to the expected facts. To make this clear vve shall once more call 
to mind the elcmeiitalist, the fictional character portrayed in the previoUvS 
section, and exaggerate the differences 'between his methodology and that 
of the organicist. 

Let US assume that the task is to predict the rating of over-all effectiveness 
which will be given a man after one year of vocational performances in n 
specified environment. If the members of the assessment staff arc cle- 
mentalistSj they will perform this task by administering a number of sfKcific 
tests which can be scored objectively and mechanically, and then, by com- 
bining in a formula the scores obtained by the candidate on the different 
tests, calculate a quotient which will rigidly determine the prediction of 
the future rating. Thus from relatively precise measures of a few per- 
formances the elementaiist will directly and mechanically arrive at his 
estimate, without the embarrassment of any intermediate process of tluJUght. 
The advantages of this method are considerable: (i) it is relatively quick, 
because it eliminates interviewing ns well as all reflection and discussion 
as to the character and merits of each candidate; (2) because it Is quick, 
it permits the assessment of a relatively large number of candidates in a 
given unit of time; (3) it is relatively cheap, l)ccause it is quick and iKcausc 
suitable staff members can be engaged at a relatively low salary, since, 
once the separate tests have been constructed, they cun be administered 
and scored by anyone capable of learning the simple technical rules; (.j) it 
can be employed on a large scale, because it is quick and cheap, and be- 
cause it is possible to find a relatively large number of technicians with 
sufficient ability to practice it; and, finally, (5) it eliminates the errors in- 
herent in subjective judgments. If the elementaiist is scrupulous nbotit 
validating each test against adequate criteria, he will discover, by trying 
one test after another, which battery has the highest predictive vahie. 

The organicist does, or should da, everything that the elementaiist docs; 
but he does something in addition which takes time and thought: he carries 
out a number of supplementary procedures (interviews, situational tests, 
and so on), makes tentative interpretations of the facts so gained, and 
attempts to arrive at a plausible representation of the personality as a whole. 
The efficacy of this process in sizing up some kinds of cases, such ns 
neuropsychiatric disorders, is generally acknowledged, but its efficacy in 
assessing the run of normal persons is still to be determined, 
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capable of improving to a signiHcant degree the accuracy of mechanical 
predictions derived from test scores alone. The truth of this hypothesis 
depends on the definition of ^‘significant degree'^ as well as on (i) the 
competence of the psychiatrist or psychologist, (2) the number and kinds 
of procedures used for obtaining additional facts, (3) the time allowed for 
diagnosis and prognosis (the length of the assessment period), (4) the 
kinds of jobs which assessees will be expected to perform, (5) the adequacy 
of the psychologist’s or psychiatrist’s knowledge of these jobs; and so forth. 

The second hypothesis made by the advocates of organismic assessment 
is that, whether the first hypothesis be true or false, the repeated practice 
of this system will result in developments of techniques and of the abilities 
involved in making dependable observations and judgments which together 
will eventually lead to a decided increase in the validity of predictions. 

Finally, there is the supremely important point that the organismic system 
is an admirable way of studying personality and, if systematically pursued, 
should greatly advance the science of man, which, in turn will lead to 
practical knowledge, useful not only in the field of selection and placement, 
but in many other fields. 

The organismic system is founded on several welhaccepted facts, one of 
which is that the action patterns observed or the performances measured 
during the assessment period are not always representative of the candidate’s 
usual behavior, because of the operation of transient factors or because 
some commonly recurrent variables of personality are either intentionally 
inhibited or not excited by any of the tests or situations constituting the 
program. 

Among the transient factors which were often found to be operating 
at Station S are the following: (i) poor athletic condition (being out of 
training) as the result of months without exercise; (2) state of mental 
exhaustion when taking the tests on the first night as the result of a sleepless 
night on the train; (3) excessively high motivation because of the candidate’s 
disposition to exert himself to the limit when competing in the presence of 
others (supervisors, critics, judges) ; (4) low motivation because of a candi- 
date’s transient underestimation of the proposed assignment or because of a 
doubt as to the suitableness of the job proposed for him. In addition to these 
are the disturbing preoccupations (overlapping situations) which the candi- 
dates bring with them— temporary worries about family and business affairs, 
and so forth. 

Every assessee, on the other hand, will possess numerous established 
dispositions which v^ill not be manifested during the assessment period, 
either because he is able to inhibit them over a period of a few days (e.g., 
neurotic tendencies, unacceptable sentiments, inclination to indolence, moodi- 
ness, or irritability), or because no situation excites them (e.g., fear of horse- 
back riding, dislike of colored people, stubborn aversion to domineering 
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leaders), or because there are no free time and no favorable conditions for 
their operation (e.g., aJcoholism, pursuit of distracting and wholly personal 
aims) . 

These considerations have led organicists to the conclusion that additional 
procedures (e.g., autobiography, interviews, situational tests, psychodrania, 
projection tests) should be included in the assessment program in order to 
obtain the information necessary (i) for estimating the strength of other 
determining variables (besides those which are directly involved in voca- 
tional activities), and ( 2 ) for arriving at a sufficient formulation of the per- 
sonality as a whole* These two aims arc complementary, since the exposi- 
tion and preliminary estimation of the additional variables (energy, motiva- 
tion, emotional stability, social relations, and so on) are steps along the 
path to a formulation, and a formulation provides the framework for a 
final re-evaluation of these variables. 

It was one of the noteworthy features of the OSS assessment system 
that it recognized explicitly the necessity of relating all observations to each 
other, not in a mechanical way, but by an interpretive process aiming at 
the discovery of general patterns and action systems, and made this the 
guiding principle of all its operations. At times a thoroughgoing applica- 
tion of this policy was blocked by the pressure of work which red need 
to a minimum the time available for discussions and reflections. 'Fhe dis- 
content of the staff members with the results of their work at sucli times 
Indicates that this phase of assessment was felt to be indispensable, 

Not less noteworthy is the way in which this basic principle was imple- 
mented and at the same time guarded against subjective distortion, through 
group participation in all phases of the work, The policy of group discussion 
and group decision as distinct from a mere mechanical process of averaging 
scores or counting votes, presupposes the possibility of arriving, in a favor- 
able case, at a common conception. Whenever this common concc[)tion 
succeeds in encompassing and integrating all the aspects of a personality 
noted by the different staff members it conics as near to the status of an 
objective judgment as it is possible to come under the given conditions. 

Step 6 — Write, in nontechnical language, a personality sketch of 
each assessee, which predictively describes him as a functioning 
member of the orgatiization, A list of ratings is an exceedingly abstract 
mode of representing a personality. It conveys no impression of the man in 
action. It does not show how tlic different variables arc integrated ihto a 
purposive whole. It obliterates .subtle characteristics which may be crucially 
Important. Therefore, a personality sketch which incorporates the informa- 
tion that is not conveyable through ratings is an essential supplement to 
the latter. It is our conclusion, indeed, after canvassing the opinions of 
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055 administrative officers, that the personality sketch is capable of com- 
municating the more useful findings. 

The personality sketch is a translation of the abstract formulation into 
everyday speech with the elimination of everything that is not relevant to the 
administrator’s task of placement and management of personnel. 

For the first few months the sketches written at Station S were very 
short — one or two paragraphs — but they increased in length as time went 
on, and for the last year of assessment averaged about eight hundred 
words each. Although the writers of these sketches were not bound to fol- 
low a rigid form, it became customary to start each sketch with an outline 
of the candidate's past history and record of achievement; to follow this with 
an account of his performances during the three-day period at Station S; 
and to end the sketch with a discussion of the interprelationsS and con- 
clusions which led to the final recommendation. 

A survey of these sketches has revealed two outstanding defects: space 
devoted to an array of uninterpreted facts and space devoted to the diagnosis 
of variables the relevance of which is not explained. In both cases the 
administrative officer is left to make up his own mind as to the meaning 
and significance of the findings. 

To turn in a personality sketch composed entirely of accounts of the 
subject's behavior in a variety of situations is scientifically useless, if not 
harmful, unless it goes to an officer who is more talented and experienced 
than the assessor who made the observations. A fact is a fact, and as 
such provides no ground for a predictive judgment. In order to predict 
one must at least infer, implicitly or explicitly, that a persisting disposition 
or attribute of the personality lies behind the fact. It is the professional 
function of the psychologist to make inferences of this sort as well as to 
report the observations which justify them. In writing sketches for lay- 
men, facts which do not justify inferences should be omitted, because 
the layman will certainly make his own inferences, automatically if not 
deliberately, and if these are unjustified, the decisions that flow from them 
may be unfortunate. 

Most of the members of the staff were psychiatrists or clinical psychologists 
who had been trained to explore the minds of their subjects for memories 
of childhood events and to report their formulations of family structure, 
infantile dispositions and fantasies, unconscious complexes, and so forth. 
Naturally, they were inclined to proceed along the same lines in interview- 
ing candidates at S and in writing their personality sketches, But in most 
instahees we ourselves did not know to what extent, if any, these childhood 
situations and events were relevant to the administrator’s task of placing 
and managing his men, and certainly the administrator himself could 
not be expected to make the legitimate deductions. Consequently, the in- 
clusion of diagnoses of this order represented so much wasted time and 
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space; and, by confusing the administrator, might occasionally have resulted 
in unwarranted decisions. 

The ideal personality sketch is one which pictures the candidate in action, 
performing work similar to that which he will be expected to do in the 
future. It is, of course, the product of the assessor’s subjective processes, 
of intuition and reason, but this is unavoidable at the present stage of 
psychology. So long as a subjective factor must operate in every decision 
that is made, it is better to bring it out: into (he open by making explicit 
predictions, each one of which is virtually a hypothesis which will lie 
proved or disproved in the course of events. 

At Station S the subjective factor was held in check by the callccdve e/Iort 
of the staff. The sketch itself was the work of two assessors, who, though 
covering different phases of the personality, were obliged to arrive at con- 
ceptions acceptable to both. Then, the reading of the report in the staff 
conference, as we shall see, brought further checks, Kach generalization had 
to be supported by sufficient evidence to make it plausible, and no generaliza- 
tion that seemed unwarranted or disregarded contradictory data was per- 
mitted to go unchallenged. Thus each personality sketch corresponded to 
the conclusions of several different minds. 

Step 7* — At the end of the assessment period hold a staff cnnfemnr 
for the purpose of rcaictoing and correcting the personality sl{ctch 
and of deciding on the ratings and recommendations of each assesscc. 
Our experience has shown that it is better to have the personality sketch 
written before the conference, so that it can be read at that time to the entire 
staff. One advantage of this practice is that die discussion of a case, 
instead of being random and diffuse, Is focused on certain crucial points 
which have been high lighted, after some reflection, by the only assessor 
who is in possession of the intimate facts of the caiulidate's past history, 
Another and still greater advantage is that no personality sketch Is incor- 
porated in the official report and sent to die administrative officers which 
has not been approved by all die assessors. 

According to this scheme, then, the personality sketch provides structure 
for the discussion, the purpose of which is to change or eliminate statements 
unjustified by the evidence, and, if necessary, to add other statements to 
cover manifestations of the personality which escaped the notice of the 
writer, 

Our hypothesis is that individual judgmeiUsS made before listening to 
a group discussion are generally less valid than individual judgments made 
after listening to a group discussion, The chief reason for this would seem 
to be that group discussion brings into each man’s sphere of reflccdon 
more facts and more interpretations than were there before, Thus the errors 
that come from ignorance of all the available evidence and the errors 
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that come from an inability to conceive of all plausible interpretations 
will be reduced. As a rule, those who abandon the decision they reached 
before discussion in favor of one proposed by another member of the group 
do so because the latter seems more valid to them. Certainly they are 
influenced, but they are influenced in the right direction more often than 
in the wrong direction, because, in general, those who are most competent 
in analyzing and reconstructing events, in distinguishing the chief deter- 
minants, are those whose presentations and arguments are most convincing. 

There are a number of other factors, of course, besides sheer diagnostic 
ability, which play a part in determining to what extent a given assessor’s 
judgments will be accepted or rejected: energy, desire to persuade, verba! 
facility, egocen tricity, valuation of his own ideas, attitude toward the ideas 
of others, general social attitudes, reputation, role (in line of authority), 
popularity, and so forth. Also, a number of factors besides intelligence deter- 
mine the extent to which a given assessor will accept the opinions of others : 
need for affiliation, dislike of controversy, suggestibility, negativism, ob- 
stinacy. Variables of this class may operate powerfully in some cases, as 
when a modest, able man is overshadowed by an aggressive one with less 
ability; but in a group of five or 'more, which is controlled in a democratic 
fashion, these factors become less significant as time goes on. The insight- 
fulness of the unobtrusive man becomes recognized, and the force of the 
more assertive person is corrected for. Anyhow, there is a tendency for 
these determinants to balance out, leaving diagnostic ability as the chief 
factor in deciding the course of group opinion. 

The other hypothesis on which the staff conference is founded is that 
the judgments of the majority are, in the long run, more valid than the 
judgments of any one member of a group, assuming that the disparity in 
ability among the members is not great. One can, of course, imagine 
a group composed of one incomparable genius and several bumptious 
ignoramuses who do not recognize his superiority, in which the judgment 
of the majority would be regularly less valid than the judgment of the 
talented individual, but a group of this order is confined, as far as we 
know, to the world of fantasy. Under certain circumstances, however, it 
may be advisable to leave final decisions to a diagnostic council composed 
of the more talented and experienced members of the staff. 

Step ^.--Construct experimental designs as frames for assessment 
procedures so that all the data necessary for the solution of strategic 
problems will be systematically obtained and recorded. At this early 
stage in the development of psychology the evaluation of each tech- 
nique, of the final ratings, and of the over-all conclusions should be con- 
sidered an essential part of every assessment program. The efficacy of no 
psychological test is so well established that one can afford to continue using 
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it without periodic checks. This means that a satisfactory appraisal system' 
must be devised fur estimating the eflectivcness of every accepted asscssee 
after he has worked for a number of months as a member of the organiza- 
tion, The appraisal system must be devised and tested at the very start, be- 
cause it defines the target at which all assessment priiccdurcs should be 
directed. If the target is not precisely discriminated, there will be no definite 
criteria for deciding which tests should be included in the original schedule. 
Since this important principle was not put into practice in inaugurating 
the assessment program, we shall postpone discussion of it until the last 
chapter. 

Besides the evaluation of the different technical procedures there arc many 
important psychological problems which can be illumined, if not solved, 
by a multiform organismic assessment program. But to accomplish this in 
a scientific manner it is necessary to set up an experimental design suitable 
to each problem, Consecjuently, before selecting the techniques and arrang- 
ing the schedule, the members of the staff should decide which problems 
they will attack first. Here again it is a matter of delineating goals, so 
that means can be improvised for obtaining the necessary data and [)rovi,sions 
made for tabulating them in an orderly manner. Since the solution of many 
of the problems will involve hundreds of statistical computations, and since 
it is desirable to know as soon as possilde which tests arc of liiilc value 
in predicting appraisals of job performances, the practice of transferring tlic 
data onto punch cards at regular intervals can be bigldy recommended. 

These are the chief points, or principles, of llic OSS system of assessment, 
A few of tlicm will be discussed at greater Icngtli in tlic last chapter, to- 
gether with some further recommendations which wc arc submitting as 
remedies for obvious defects in the original system. The next cliapters 
will describe in detail how the principles outlined in tliis cliaptcr were 
applied in the three-day program at Station S, in the one-day program at 
Station W, and at the other assessment stations, 

'■Throughout this volume the term "appraisal" is used to tlenute the prtKcss of arriving 
at ratings and otlicr judgments of a man's cflcctivcncss after he has been working at his iob 
for some time. In contrast to "appraisar' is the term '^assewrnent," which we have been using 
to denote the process of arriving at /W/rnW ratings and other judgments of a man's ciTcctive* 
ness before he htis begun working. The term "validation" or "evaluation" refers to the pfcKicU 
of comparing assessments with appraisals. 
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ASSESSMENT AT S: PROCEDURES 


The preseat chapter describes the program at Station S during tlie last 
phase of its career, at which time, we should like to think, S was at its 
highest level of effectiveness, although there is certainly no member of the 
staff who would not claim that at least one test which hud been used 
earlier fulfilled its purpose better than the procedure which rejtlaccd it. 
Had assessment continued for another six months the picture to be presented 
here would undoubtedly have been different in certain respects, thougli 
it is unlikely that its basic structure would have been radically altered, for 
the latter had remained unchanged since the summer of 194.^1. No account 
of a single session of S can do full justice to its ever changing program, 
to the variety of constellations of tests and procedures which characterized 
its history, or to the interesting theoretical and practical consideratitms which 
led to each of the changes. To ignore these aspects of the program is to 
lose much of its unique quality. It can only be hoped that other sections 
of this book will succeed in conveying to the reader something of the fer- 
ment and onward surge of S. 

In the present account, the procedures of the program will be presented 
in the order in which they were experienced by the candidates, thus in 
effect taking the reader, as the candidates were taken, through all steps of 
assessment. But whereas the success of the assessment program required chat 
the purposes of the various tests and the meanings of the situations should 
be hidden from the candidates, the exposition of the program requires that 
the reader be taken behind the scenes and into the staff room where he 
may become acquainted with the aim and rationale of each procedure. 
In other words, the reader will have an opportunity to view each part 
of the program, first, as it was experienced by the candiclatc.s, and second, 
as it was conceived and utilized by the staff. 


RECRUITMENT OF CANDIDATES 


It was not the function of 
OSS personnel, but merely 


S or of any of the .assessment units to recruit 
to assess them as persons and as candidates 
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for the particular OSS overseas assignments for which they had been 
recruited through one of three channels^ 

Within the organization a Personnel Procurement Branch (PPB) was 
charged with the responsibility of recruiting personnel from the various 
armed services. It was the practice of the other branches of the organization 
to supply PPB with their own job descriptions and to requisition through it 
the number of "bodies’’ which would be required to fill these assignments, 
With these job descriptions in hand and with authority granted by the Joint 
Chiefs of Staff to recruit military [jcrsonncl, rccrultlrig officers of the OSS 
visited various Army camps and naval stations to interview likely can- 
didates. 

The secrecy of OSS operations and the restrictions placed by considera- 
tions of security upon what recruiters might say when interviewing men 
lessened considerably the precision of their descriptions of the jobs for 
which they sought volunteers. Consequently many men had only the haziest 
idea of the kind of organization they were joining or the kind of work for 
which they were volunteering when they expressed a willingness to be 
assigned to OSS. Thus though ihc very purpose of PPB was to select men 
best suited for OSS assignments, the restrictions placed upon its officers 
inevitably introduced into their rccriiitinent a selective factor of special 
appeal to a particular type of person. Indeecfi there is reason to believe that 
this method of recruiting brought to the OSS as volunteers a dispro[>ortioa- 
ately large number of men attracted by the mystery of secret missions and 
by the adventure of what appeared to he unusually hazardous duty, and 
there is good reason to doubt that this type of person was always best suited 
for the kind of work for which he volunteered. Of course, among the men 
who did volunteer for service, a request for transfer to OSS was made only 
for those who, in the recruiter’s judgment, were especially qualified. 

It is clear that every recruiting officer had a picture of the requirements 
for successful performance in the various jobs, but unfortunately it Is not 
so clear that the pictures were identical with each other or with those in the 
minds of the members o£ the assessment stall. Indeed, so convinced did vve 
become of their discrepancy that steps were taken to bring them together 
by arranging that recruiting officers go through the one-day assessment at 
W as students and then visit S as observers. 

Whatever the agreement or disagreement between the concepts of job 
fitness held by procurement officers and by the assessment staff, recruiting 
constituted a first rough scrccMilng through which volunteers for OSS had 
to pass. There was no guarantee, lunvever, that those whom the recruiters 
were willing to let through the screen wouUl ever reach OSS. Requests for 
their transfer were made through channels, but channels sometimes became 
blocked. Anyway, for a variety of reasons only a portion of the military 
personnel requested was ever transferred to OSS, 
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The second channel through which individuals came to OSS, and even- 
tually to assessment (provided they were slated for overseas assignment), 
was the Civilian Personnel Branch. This branch recruited, for the most 
part, though not entirely, civilian men and women, for secretarial and 
stenographic positions in the various branches of the organization and con- 
sequently the majority of its recruits were women. Many persons who knew 
of the existence of OSS sought employment in it through this channel, but 
they were by no means numerous enough to meet the large need for civilian 
personneh For this reason the branch employed the usual and recognized 
techniques for attracting applicants for the positions which it had to fill— 
vaguely worded newspaper and magazine advertising, and so on. 

The various branches at all times did a certain amount of their own 
recruiting. This was the third channel of entry into OSS. Persons already 
within the organization and aware of its needs for personnel understandably 
enough often recommended friends, acquaintances, and sometimes relatives 
for positions known to be vacant. This sort of individual recruitment can 
be very effective provided the sponsor is a good judge of others, primarily 
interested in the welfare of the organization, and impersonal in the recom- 
mendations, which he makes, but it is also subject to various forms of abuse, 
only one of which is nepotism. One of the important contributions, not to 
be overlooked, which an assessment staff can make to any large organiza- 
tion is the check which it places upon such abuses, unwittingly since it 
knows the names and family connections of none of the candidates whom it 
assesses. In OSS, however, this check was placed only upon those who were 
being considered for assignment overseas; assessment units were not asked, 
except in rare cases, to pass upon the fitness of candidates for jobs in Wash- 
ington or within the continental limits of the United.* States. 

Regardless of the channel through which a new recruit came to OSS, he 
was told little about the nature of the organization he was joining or of the 
specific assignment for which he was being considered. This was especially 
true in the case of candidates for overseas assignments, who, if not recom- 
mended by the assessment staff for their projected billets, were seldom re- 
tained in the organization. If military personnel, they were usually trans- 
ferred back to the unit from which they had been recruited; if civilians, they 
were simply not employed, but .in neither case were they told that their 
failure to be retained in OSS had anything to do with their performance in 
assessment. It was important that persons who might not be retained in 
OSS should not know too much about the organization, For this reason 
candidates came to Washington with little idea of what they were getting 
into and by the time they had been briefed for their sojourn at S they knew 
little more. 

Men who had been interviewed at military installations, who had volun- 
teered for the kind of work so sketchily outlined to them, who had passed 
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the recruiting officer’s screening, and whose transfer to OSS, requested by 
PP13, had been granted by the proper authorities, received, though some- 
times not until weeks or even months after the recruiting interview, orders 
to report to Washington. These, following their arrival, were kept in hold- 
ing areas or given leave until such time as they could be sent to assessment 
school. This meant a further delay of usually not more than a day or two, 
but seldom more than a w^eek. This whole [)criod of waiting on the part of 
men eager for a new assignment was not unimivortant in creating some of 
the tension whicln candidates frequently showed upon arrival at the as- 
sessment area. 

Civilians who had expressed interest in an overseas assignment with OSS 
were asked if they would be willing to come to Washington for a few days, 
and in most cavses were told frankly that they would spend this time at an 
assessment school where an attempt would be made to determine where 
they could best be fitted into the organisation. If they agreed to this they 
were entered in an assessment class and asked to report in Washington either 
on the day they would go to the assessment station or, in some cases, on 
the preceding day. 

Whether he knew it or not, and regardless of whether he had been re- 
cruited from one of the armed services or from civilian life, every person 
slated for an assignment with OSS was cheeked thoroughly by the Security 
Branch of the organization. In many eases the security check of candidates 
had been completed before they entered assessment as students. 

BRlEflNG CANDIDATES FOR S 

After his arrival in Washington and prior to being sent to S, each candi- 
date was interviewed by a representative of the branch for which he had 
been recruited. This was usually the officer who would supervise the candi- 
date throughout his training in the OSS schools, provided he received a 
recommendation from the assessment board. This interview, at least upon 
occasion, served as a second screening of candidates, for there were instances 
in which an administrative officer was so certain that a candidate was not 
up to the work for which he had been recruited chat he canceled his registra- 
tion in the S class and requested his transfer out of OSS at once. 

Practice varied widely among the branches as to what was told candidates 
about their projected assignments and in any one branch the amount of 
Information given candidates was far from constant. It was sometimes our 
impression that tlicrc was a high correlation between what a candidate knew 
about his projected a.ssignmcnt and the impression which he had made upon 
the branch administrative officer at the time of his interview. Information 
possessed by students had varied from detailed knowledge of the specific 
jobs for which they were slated to no knowledge at all about their proposed 
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assignments and even complete misunderstanding about the nature of the 
organization which they had volunteered to join. 

At the time of his briefing the candidate furnished the data required for 
his Student Information Sheet, provided this had not already been obtained 
from the very complete form which he had earlier filled out for use by the 
Security Branch. The Student Information Sheet was an important paper, 
for it accompanied the candidate to S and provided the stall with all the 
information they would have about him at the beginning of his assessment. 
But of this, he, of course, knew nothing. 

Then he was told that he was being sent to the country to attend an 
assessment school for three days where he would be asked many questions 
and given a number of tests by a group of psychologists and psychiatrists, 
It was important that he do his best, and lest he feel apprehensive about such 
a program of analysis he was assured that those who had preceded him had 
almost invariably enjoyed it; it was likely that he would too. And then he 
learned for the first time that during his stay at the assessment school he 
would not be known by his own name. He was going incognito. He was 
not to talk about himself or say or do anything that would reveal his true 
identity. Letters, photographs, and anything marked with his initials would 
have to be left behind. All this, he was told, was for his own protection, and 
for the security of the organization. And now he would have to choose 
a name, a student name by which he would be known during assessment. 

To those who had heard of OSS as a cloak-and-dagger society this seemed 
like the real thing at last, but to those who thought of OSS as a straight 
military outfit, or to those who had no idea of what OSS was, this was a 
little puzzling. But to all alike the loss of name and identity, suddenly an- 
nounced to them, must have created at least some measure of insecurity and 
tension. To be bereft of one’s persona^ at least such tangible parts of it as 
name, address, profession, and present status, whether military or civilian, 
was to have the ground cut from under one’s feet. But there was no turning 
back now. For some, what lay ahead must have appeared as an exciting ad- 
venture, for others a frightening experience, for others nothing but foolish- 
ness, and for still others merely an interesting challenge of their resource- 
fulness in playing their part without a slip. For each it had a special mean- 
ing. The pity is that we had no way of fathoming these meanings at the 
time. Had we been able to discover them we should already have known 
something significant about our candidates. 

The student was then given a mimeographed copy of his instructions. 
These were a reminder to him of all he had been told, of his student name 
and class number, which he would do well to learn at once. They also indi- 
cated clearly the exact time when, later i'n the day, he was to report to 
Schools and Training Headquarters in the old red brick schoolhouse at the 
corner 'of 24th and F Streets. He was warned not to lose this copy of his 
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instructions, which was to be his pass for transportation and admission to S, 
Prior to his reporting at licaclquaricrs, he was to go at a specified time for a 
routine physical checkup at the Medical Dispensary. 

If the candidate tvas an enlisted man he discovered that he was to report 
at headquarters at 3:30, if a civilian at 4:00^ if an officer at 4:30. The purpose 
of this staggered reporting was to keep students from learning about the 
military or civilian status of their classmates. Ideally each student would 
have reported at a dilTcrent time, hut this was not practicable. The arrange- 
ment actually employed served at least to keep the students in any one group 
ignorant of the status of those in the other two groups, and this was an 
advantage. 

Having reported at headquarters, students were led to the basement of 
the building and there asked to remove all their outer clothing and to 
destroy all identification marks on their underwear. Each man was then 
issued two pairs of Army fatigues, one of which he donned at once, a pair 
of heavy Army bools if he had none, and in winter an Army coat and cap. 
Now he knew that for tlie next three days he would be without his clothes 
as well as without his name and true identity. And with his clothes went 
his eagles if lie were a c<donel, or his stripes, three up and three down, if he 
were a master sergeant, or the comforlahle cut and reassuring feeling of his 
tweeds if he were that kind of civilian. All that he had experienced in the 
day when he was told that he would have to hide his name and true identity 
was increased when he found himself now deprived of the even more 
tangible signs of his rank and station. 

Having acciisiomcd himself as well as he could to his fatigues, he was 
led with others into a room, there to wait until five o’clock. When others 
joined him later he had no knowledge of their rank; he could only guess 
and they could only guess about him. This was not precisely an atmosphere 
in which one felt at ease, and when one spoke it was usually humorously 
in an attempt to ease the tension. After all, one could not talk about the 
things it would have been so natural to discuss at such a time. 

At last a sergeant came to call the roll of student names, and if one 
watched carefully one could observe those who already felt at home in their 
new roles and those who, on the other hand, failed to recogni2:c their names 
when called, All present and accounted for, they were led outside to a canvas- 
covered Army truck. In this they were trans[H)rted over the eighteen wind- 
ing miles to S, 


ARRIVAL AT S 

Upon arrival at S, usually between *5:30 and 6:00 in the evening, the 
students were welcomed by the director and one or two other members of 
the staff, dressed, as members of the staff always were, in civilian clothes 
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with name tags on their shirts. It was our desire that the candidates should 
feel genuinely welcomed, and we hoped that this informal greeting would 
help to allay whatever feelings of uncertainty, insecurity, or resentment they 
might be experiencing at this moment. But even a simple, civil greeting 
was enough to disturb the equilibrium of some students. One of them, 
rigidly GI in his attitudes, complained upon his return to Washington about 
his reception, at St he thought the candidates should have been addressed in 
military fashion. 

It was usually a fairly solemn and somewhat uncomfortable group of 
men who climbed out of the truck, a group quite different in mood from 
the one that would leave the area four days hence. Often they had ridden 
to the area in silence, intent upon, sizing up each other or upon trying to 
observe road signs indicating where they were being taken. Their day in 
Washington had done much to create in them a mood of tension, and now 
most unexpectedly, instead of finding themselves in an Army camp, they 
were deposited at the front entrance of a fine country estate. What sort of 
organization was this OSS? 

And now having been greeted they were invited into the main hcni.se. 
There, settled in the room which they would come to know well as the 
classroom in which all group written tests would be given them, they were 
asked for their admission passes to the area. (These were then (Wrecked 
against the Student Information Sheets which the driver of their truck 
had brought to S, and from them the class list was made up and a name tag 
for each student prepared.) After their passes had been collected, they were 
addressed by the director somewhat as follows: 

Please make yourselves at home. Once more, on behalf of the staff, I want to 
welcome you to Station S and to express the hope that your stay here will be a 
pleasant one. 

I believe most of you have been told tliat this is an assessment school. Our job 
is to seek to discover your special skills, unique abilities, and individual talents 
in order that they may be put to the fullest use in this organization, As a matter 
of fact, I know of no agency or institution or organization that takes more pains 
in the selection and placement of its personnel than does the one with which wc 
are all connected. It is our job here to see that square pegs arc not put into 
round holes. 

Although this is our function, it is important that this fact as well as the fact 
of our connection with the organization should be kept secret from the com- 
munity in which wc are located, And so to hide the nature of our work here wc 
gave out for local consumption a “cover story“ designed to conceal our true 
activity. That story was that this is an Army Rehabilitation and Reallocation 
Center for men returned from overseas, residents in the near-by village 
accepted this fiction, but in the richness of their imaginations they proceeded to 
embroider the story until today they are firmly convinced that you are all serious 
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mental cases, We hope you do not mind that those in the community think you 
are peculiar; wc know tliat you arc not. 

The security regulations of the area were then explained to the students; 
they were to remain within tlic limits of the farm during their stay at S; 
they were not to speak to the two farmhands; they were not to go to the 
kitchen during the day but were invited to do so in the evening if they 
wished to raid the icebox; finally, during their stay at S they would have 
no communication with the outside world except, of course, in case of 
emergency. 

Now a word about your own security at S, Each of you has come here under 
the cove’r of a student name. That name may be your first name, or middle name, 
or nickname, or a name that has been arbitrarily assigned to you, Wc don't 
know which it is, and wc don't care. The important thing is that during your 
stay here you will be known to your associates and to the staff alike only by your 
student name. There are many things which we on the staff will want to know 
about you, but wc do not need to know and do not want to know your real 
name or true identity, 

Since, for reasons of your own security later in this organization you have to 
be under cover during your stay here, we have sought to make the most of this 
[act and so have created something of a game and very definitely a test out of 
this reciuircrncnt of cover, Just as wc, as an area, have a cover story, so each of 
you will be asked to develop, to spread, and to maintain as consistently as 
possible a cover story designed to hide your true identity during your stay here, 

In creating your cover story there are certain facts about yourself which each 
of you must change, With your associates as well as with us on the staff, you 
must claim to have l>ccn born some place other than the place where you were 
born; you must claim to have been educated in institutions other than those 
where you were educated; you must claim to have engaged in and today to be 
engaged in work other than your true one; and you must claim to live in a place 
other than the one In which you really reside. 

These are the minimum requirements for your cover story; obviously the more 
elaborate you can make it, yet still succeed in maintaining it, the more interesting 
your story will be for all of us, T^t me warn you, however, that before leaving 
this area your ability to defend your cover story under grilling will be tested, 
Accordingly, it will be well for you not to make your cover story entirely out of 
the blue. For example, it might be unwise for you to claim to lx: a medical 
doctor if you know nothing about medicine, for there just might be a doctor in 
this group who by questioning you could soon demonstrate that you know 
nothing about medicine. Similarly, it might be very unwise for you to claim 
Chicago as your place of residence if you have never been there and know 
nothing about it, On the other hand, if you have visited there or lived there as a 
boy you might well claim it now as your residence. In the same way, a hobby 
or interest of yours might well serve as the basis for the job or profession which 
you will claim as yours. In other words, you will do well to draw upon your 
experience — in fact you have to — but you should do it in such a way as to hide 
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your true identity and to meet the conditions which have been outlincel to you. 

With the exception of certain conditions which vve call X conditions and which 
I shall explain to you in a moment, you are at all times during your stay here 
to give your cover story both to your associates and to members of the stufF. 
But let me warn you now that members of the staff from time to time will try to 
trap you into breaking cover; for example, by asking you casual cpicstions alxuit 
yourself when you are off guard. Don^t be caught. 

In order to do our job here we have to learn a good deal aUvit you ami about 
your training and experience, and to get that information wc will establish from 
time to time between you and ourselves what arc known as X conditions. Under 
X conditions you will be at liberty to speak and to write freely and frankly 
about yourself, with this exception, that you will never reveal your true name 
here. 

You will all be under X conditions for the first time this evening in this room 
when you will be asked to fill out a personal history form. In filling out this 
questionnaire you will be writing under X conditions, wliich means that you are 
to answer the questions fully and truthfully. No questions will Ixi asked wliich 
will break your security. Remember, however, to sign tills paper, as you will 
sign all papers here, with your student name only, I want to cmphasiv.c this, 
for upon occasion there has been misunderstanding on this point; and a student 
in answering the personal history questions has given us his cover story rather 
than the true facts of his life. That makes interesting, if fantastic rcatling; but 
it is not what we want or need. 

During your stay here each of you will be interviewed by a lucniher of the 
staff. This interview, marked by an X on the individual schedule of appoint- 
ments which will be given you, will be held under X conditions, and during It 
you will be allowed and indeed expected to speak quite fully and frankly alinut 
yourself. But here again you will not give your true name, 

It sometimes happens that in the period scheduled for an interview there is 
not time to discuss with you all the things we should like to discuss. In tliat 
case, your interviewer may arrange to meet with you another time, and if he docs 
so, stating that the second interview is to be held under X coiulilions, then 
again you will be free to speak quite freely and frankly about yourself. 

If at any time a member of the staff takes you away out of earshot of others 
and asks to speak with you under X conditions, then again, with X conditions 
established, you may speak freely. 

Finally, if you, for any reason, feel you must speak truthfully about your- 
self to a staff member, ask for X conditions and if they are explicitly agreed to, 
then again you are at liberty to speak quite frankly and honestly about yourself. 

So much about your individual security and your cover story; now a word 
about the program here. 

During your stay you will be given many tests, put into many .situations, asked 
to take part in many procedures. I think you will find all of them interesting; 
you will probably find some amusing; you may find some upsetting. It is impor- 
tant that you do your very best in every situation; but having done your best, 
don’t worry about your performance. You may feel that you have done badly, 
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but it you inquire ul your as.s{>ciaics about their feelings^ I’m sure you will dis- 
cover that their reactions will he much the same as yours. 

With a few exceptions, the same tests will be giveix to all of you, though we 
know that they arc not ccjually relevant (or all of you. We expect you to do 
well in some of the tests, but not so well in others. DifTcrent ones of you will 
naturally excel in difTcrciU iiclds. So just do your best and don’t worry. If you 
can adopt this atiltmle ytxu will do a better job and you will Ixi much happier 
during your stay here than if you worry al)out your performance. 

You will certainly want to talk ubcuit the various procedures with each other, 
but we have to ask ytni n(»t to do so until you have all been through them. I am 
sure you will understand the reason (or this request, for if those of you who first 
take a test tell othcr.s alw nu it before they have taken it, the test will not be com- 
parable for all of you. It is im|Kjrtant that you all be equally uninformed about 
the situaticuis in which you will find yourself. We do not wish, however, to im- 
pose any unnecessary silence ap()n you, so when all of you have had the same 
test you may talk al>out it. You will know that time has come when staff mem- 
bers are willing to discuss the test or situation with you. 

The welcoming talk ended with an explanation of the conditions under 
which stiicleuts wcailtl live at S, They w^ere informed that they would .sleep 
in the main hou.se with the senior staff, that they would be awakened by an 
alarm clock at yaxo, that breakfast would be served at 7:30, lunch at 12:30, 
and dinner at They were oiskcd at mealtimes to distribute themselves 
at the small tables in the dining room so that inumhers of the staff might 
cat with them. They were informed that the Post Exchange Supply Store 
would he open only (or about ten or fifteen minutes after each meal and 
were urged to buy at such times what they would need until the next time 
the supply store would he 0[)cn. Innally, they were urged to make themselves 
at home and assured that whatever they were thinking or feeling at the 
moment about the program that lay ahead, we were sure they would enjoy 
their stay at S. 

Then they were taken to their sleeping quartens on the second floor, 
where they chose beds in the three student rooms. Here they were given 
student name tags to wear on their fatigues and a few minutes later were 
summoned by bell to dinner. 


FIRST EVENING 

The work of assessment started at the moment the students climbed out 
of the truck at S, The way a catididatc greeted the staff members, the case 
with which he used his student name in introducing himself, the position 
he took spontaneously with respect to the others, whether leading the group 
into the house ov slowly bringing up the rear, were only the first of the 
many observations that would contribute to the final picture of each man. 

There were those, both old and young, who jumped agilely out of the 
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truck, others who climbed down haltingly, awkwardly, or even timidly. 
There were those who walked briskly toward the staff members, those who 
indeed had more the manner of greeting than of being greeted, those who 
hung back, obviously shy and embarrassed. There were those who S[X)kt 
their names as though they were their own, loudly and confidently, those 
who spoke them softly and with guilt as though telling a lie, those who be- 
came blocked, unable to speak any name, in their confusion remembering 
only that they were not to use their own names yet unable to recall the new 
name given to them so short a while ago, and those who, having sjxjkcn 
their true names, suddenly realized what they had done, and, much embar- 
rassed, tried to correct their mistakes* Each man shook hands in his own 
way, and each, in so doing, told us something about himself. 

As they sat in the classroom listening to the director explain the rules by 
which they would live for the next few days they could not help revealing 
more of themselves. There was Karl, middle-aged, obviously a foreigner 
from his manner, possibly a German refugee-one would have to check on 
that later — who leaned forward on the edge of his chair eagerly trying to 
follow everything and who, in the tenseness of his manner, revealed the 
intensity of both his mood and his motivation. There was Bob, alert in 
mind and body, delighted by the instructions about the cover story, clearly 
impatient to match his wits with us on that score. There to the left was 
Andy, sprawling in his chair and slouched against the wall, evidently, taking 
delight in acting hard-boiled and doing his best to show us we could not 
intimidate him. There was Matthew, probably a keen fellow in his day, 
but now certainly tired and confused, and we wondered for what possible 
job in OSS he could have been recruited. Then there was the young fellow 
who looked hardly seventeen who had chosen a seat in the front row and 
who, when the group was asked if there were any questions, raised Itis 
hand and stood up to ask his, like a little boy in school. And on the back 
row was the fellow who insisted that he could not make up a cover story 
because he had known a member of the class at a previous station. Of course, 
we did not know any of their student names at this time, but we would 
learn them later and remember how they had behaved during the welcom- 
ing talk. 

Even the way in which they behaved when shown their sleeping quarters 
was often significant. Most of them took their assignments without question, 
but there were those who asked for special consideration, to move to a larger 
bedroom, because it was more airy or because there they could sleep in a 
lower rather than an upper bunk. A sense of humor or a dead scriousnc.ss 
about the situation was sometimes revealed by a lack of concern or fussy 
meticulousness. 

The first meal was extremely important in the program of assessment, 
for here most members of the staff got their initial impressions of the candi- 
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dates* For the most part^ conversation tended to be reserved if not inhibited. 
After all, most cjf the tilings which would have been the natural topics for 
conversation— the places from which the caiulidatcs had come, the things 
they had clone, what they lujpcd to do in the immediate future, the places 
and pcrsniivS they might have knrnvn in common— all these were excluded 
from conversation, and rarely did a candidate so early in the program feel 
safe enough in his cfivcr Mory to talk about his fictitious self or risk being 
asked (picstums Uy others. 

Usually what ct)nvcrsatinn there was focused upon such innocuous topics 
as the wcaihcr, the trip to S, the food, and the like. We sometimes found 
it interesting to ask the candidates what sort of place they imagined they 
were being taken to when pul into the truck, and thought at times that we 
noted a congruence ot their answers— Army tents, an Army camp, a country 
estate, a country club' ■ with other characteristic attitudes and expectations 
which they later revealed. Of course, there was the latest news to discuss, 
had anyone known it, hut the students had usually been so busy all clay 
being briefed and made ready for their trip to S that they had had no time 
to read a paper or listen to the radio. For this reason, those who were able 
to speak of the latest dcvelopinents of the war, especially if they could also 
discuss the background of the nunc recent events, revealed thcm.sclves as 
the more highly motivated of the group. Something of the social and 
political scnrirncnts, the racial and sectional prejudices of the students could 
be sensed not only at meals but also at other moments of informal gathering 
and conversation. 

It the first meal had deme nntliing more than to reveal clearly those 
students with sufficient selFassurancc to he immediately at ca.se in a novel 
and uncertain situation and those wlio, unlike them, were full of uneasiness 
and apprehension, it would have been a valuable part of the program, 
Actually it revealed much more. Every conversation in which a student took 
part, e.spccially those which he initiated, revealed attitudes and sentiments, 
biases and preiiuliccs, ideologies and faiths, purposes and hopes, more richly 
and with more siilule nuances than any standardized paper-and-pencll tests 
which we might have cmplf^ycd for the purpose. 

Even the half hour after dinner yielded data for our assessments. Whether 
the students adjf)urncd to the living room to read, to listen to the radio, to 
piny darts, tr) engage in conversation among themselves or with staff mem- 
bers, or to withdraw by themselves all this was grist for the assessment mill 

The work of the first evening l^egan at seveti o’clock when students were 
called into the classroom. There they were given a number of pape^nnd- 
pencil tests of intelligence and of personality and were asked to fill out a 
rather detailed personal history questionnaire. The schedule of procedures 
chosen for this first evening had one central purpose— gathering material 
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which would prepare the staff members for their interviews with the cancli- 
dates. From first to last die clinical interview with the student was the 
nucleus of the assessment program, but our experience soon taught us that 
the amount of profit derived from an interview was greatly increased if the 
interviewer was well prepared before meeting the subject. 

There are many historical facts which the average person does not hesitate 
to reveal, and these it seemed might as well be written down by the subject 
in advance; especially so since the limited time of the Interview would 
probably be taken up with matters which were not easily set down in black 
and white. Moreover, if the interviewer could be oriented with respect to 
the manner of man he was to deal with and have at hand a broad outline 
of the life history he was to explore, he started with a definite advantage. 
Accordingly, on the first evening of his stay at S the student was a.sked to 
fill out a Personal History Form, and the interviewer made it hi.s business 
to study this product before seeing his subject the following day, or on the 
day after that. 

More important, it seemed that the interviewer would make the best use 
of his time if he knew in advance what were the ‘‘problem areas” in the 
subject’s personality. If the interviewer could know in a general way what 
were the subject’s major preoccupations, sentiments, and attitudes, he could 
decide what things ought to be explored in more detail; and if he knew 
what general type of personality he was to face and had some idea as to 
the unconscious trends that were at work, so much the better. Accordingly, 
the students were given certain projective procedures early enough in the 
program so that the interviewer could make use of the results. 

It seemed important also for the interviewer to have an approximate idea 
of the general intellectual ability of the candidate before interviewing him, 
and for this reason two tests of intelligence were included in the battery of 
group procedures administered on the first evening. 

And then, to aid the interviewer in questioning his subjects, especially in 
attempting to determine the degree of their emotional stability and the 
extent to which they suffered from nervous tension and anxiety or tended to 
convert such tensions into physical symptoms, each candidate was asked to 
fill out a psychosomatic inventory and a health questionnaire. 

To get some indication of their attitudes toward widely different condi- 
tions of work and their willingness and ability to adjust to them, the candi- 
dates were also given a work conditions questionnaire. 

Those group procedures which involved the more conscious, overt, and 
public layers of the personality were given first, while those which were 
designed to tap the deeper dispositions of the person were not offered until 
the novelty of the situation had disappeared and with it some of the can- 
didate’s self-esteem defenses. 

It seemed wise to begin the evening program with a type of procedure 
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which would be well kixjwn to the majority of candid atCvS. For this reason a 
standard intelligence test such as mrjst n{ them had taken in the past was the 
first given. During the last months at S, this was the Otis Self-Administering 
Test of Mental Al)ility (lliglicr h,xaminiuiou) with a twenty-minute time 
limit. ^Ihe instt iictifuis were easy to and the scoring was rapid. It 
was ado[)tcd near the end of the [)rogram because the change in the as- 
sessment populatum luul removed the reasons for using the nonverbal tests 
previously employed, l-iarlicr tlierc liad heen many Europeans recently 
arrived in the United States who were cliaracteri/cd by varying degrees of 
language lianilica[\ Also the use of a standardized, well-known test per- 
mitted a direct comparison between the assessed population and tether 
populations. 

Sentence Completion Test— The second test of the evening was Sentence 
Completion ^vlucli, tluHigh not included in the original program at S, 
was increasingly valued by tlic staff. One of a number of projective tech- 
niques tried out in tlie program, it was the only one in use at the end. 

The purpose of this tc^^t, like that of all projective procedures, is to entice 
the subject into revealing liiinself without his becoming aware of the fact 
that he is doing so. 

In all projective procedures the object is to stimulate imaginative processes 
and to faciliiatc their cx[)rcssion in word or in action, This is accomplished 
by asking the subject to respond—to complete, or explain, or interpret, or 
give associations— to more or less ambiguous stimulus material. The subject 
attempts to give rcs[H)nscs which are reasonable or logically related to the 
stimuli) but a pcrstmal factor usually introduces itself into his constructions, 
and it is pos.siblc to derive freun them knowledge of his wishes, fears, sentl- 
mentS) and attitudes. 

In the sentence completion procedure employed at S, the ambiguous ma- 
terial consisted of the beginnings of a hundred sentences, and the subjects 
were given the task of completing the sentences as rapidly as possible. 

This was essentially an association test. Since the instructions emphasized 
speed of response, students tended to finish the .sentences with the first 
thoughts which came to mind. Responding under the pressure of time, 
they expressed much which they would ordinarily have inhibited. The 
peculiar atlvaruage of the Sentence Compleilon Test over a simple word- 
a.ssociation lest lay in the fact iliat the dynamic rdation.ship between the 
structured siinnilus and die response was more easily discerned in a com- 
pleted seiucacc than in a pair of words. Tims instead cjf 'hlrivlng force — 
failure,” the stimulus and resi^tmsc might be, indeed in one ease was, ‘‘The 
main driving force in my life is- ’--my fear of failure.” 

In deYck)ping the test an attempt was made to include phrases whose 
completions would shed light on at least twelve areas of personality. These 
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were the areas of (i) Family: attitudes toward parents, siblings, and the 
family as a unit; (2) The Past: childhood and early events that may have 
resulted in lasting impressions; (3) Drives: the major motivating forces 
that spur the subject on to action; (4) Inner States: the subject’s feelings and 
attitudes toward himself; (5) Goals: the ends toward which the subject 
strives; (6) Cathexes: the objects which the subject likes, the activities in 
which he participates, and the ideas which interest him; (7) Energy: the 
productivity of the subject; (8) Reaction lo Frustration and Failure; 
(9) Time-perspective: orientation to the past or to the future; (10) Op- 
timism-Pessimism: expectations of success and failure; (ii) Reaction to 
Others: inferiors, equals, and superiors; (12) Reactions of Others; what, 
according to the subject, his friends think of him. 

The items in the test underwent many revisions. Those retained at the 
end were the ones which were discovered to have low indices of stereotypy 
or, conversely, high indices of uniqueness. This index depends, in part, 
upon the item itself. Those words or phrases which, in the Gestaltists’ 
terminology, “demand” a single word or phrase for satisfactory closure are 
bad items for a sentence completion test. For example, “At the end of a 
long job, Joe usually . . invariably had a high index of stereotypy since 
it demanded “was tired” for its completion. Widespread social and cultural 
factors also produce high indices of stereotypy. “When he heard the news 
of Pearl Harbor, Paul . . required the completion “enlisted” as often from 
civilians and draftees as from volunteers. Stereotyped completions are dead 
wood; they add nothing to the understanding of the single case, and it was 
the individual case with which we were constantly concerned in assessment. 

All of the items in the test were relatively unstructured. Obviously there 
was no right or wrong response, and no single word or group of words was 
better than any other except in so far as it might reveal more of the person 
who had written it. 

All sentence beginnings referred either to the subject (e.g., “I admire . . .”) 
or to another person (e.g., “Charlie was happiest when . . This made for 
variety in construction of items and helped to disguise the true purpose of 
the test. The chief reason, however, for using sentences which referred to 
another person was the assumption which underlies all projective pro- 
cedures: that in his interpretations of the behavior of others, a man is very 
likely to reveal some of his own motivations. 

The test was divided into two parts, each consisting of fifty incomplete 
sentences, with approximately half an hour of other activity interposed 
between the giving of the two sections. Early experience with the test given 
as a unit had shown that it was too long. Such factors as fatigue and bore- 
dom tended to reduce the amount of material that could be obtained when 
students were asked to complete one hundred sentences without any inter- 
ruption; many sentences were left blank, or single words rather than phrases 
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were used for completions* The splitting of the test into two halves with a 
break between them obviated these difficulties and> in addition, provided an 
Opportunity for the subject to change his mental set toward the task, This 
was not often necessary, but there were instances in which a student who 
had adopted a /lipparit attitude toward the first half of the test became 
serious when the vsecond half was presented and completed the sentences 
in a straightforward manner in accordance with the directions. 

In splitting the test, care was taken to make the two halves as nearly coiU" 
parable as p)ssihlc, distributing between them items which were dc- 
signed to elicit the same or similar atiitudcs and sentiments or which de- 
scribed the same or similar situations, flcvcral items were introduced into 
both halves in exactly the same form; others were presented in the first 
person in one half and with reference to anorher person In the other half, 
thus providing internal cliecks on tlie reliability of the test as a whole. 

The oral instructions for the Sentence Completion Test were as follows i 

Please do not turn these pa[x:rs cjvcr until I tell you to do so. 

The first thitig you arc to do when you turn your l>apcr over is to write your 
name and class in the s[nK‘es [u'ovicled at the top of the page. 

Beneath that you will find some words whicli arc the iKginnings oE sentences. 
Your task is to complete these sciitenres as ([uiekly as possible, l>earing two things 
in mind; first, when you arc through with the sentence it must \)c a complete 
sentence; and second, it must make sense. 

For example, supfM>sc yarn should see on the page, “Ttulay is . . You might 
add, “a sunny ilay." or "Friday or "ilie day after yesterday," It docs not matter 
whether you use two do/.cn words or just (uic wrjrd, so long as it is a complete 
sentence and makes sense. 

You arc to <lo this task as tjuickly as |)t)ssible. Therefore, when you are finished, 
raise your hand and I sluill collect your paj^r and mark the time on It, 

There arc three sheets containing fifty sentences, so Ik sure you have not 
skipped any pages Ik fore you hand in your pa|>er. 

Arc there any tjue.stions? 

Remember, first write your name and class at the top of the page and then 
proceed immediately to completing the sentences. 

Ready? Begin I 

Approximately half an hour later the sccorul half of the Sentence Com- 
pletion Test was presented with the fid lowing instructions. 

Did any of you notice that it said "Part I" at the top of the Sentence Com* 
plction Test you took earlier this evenmg? Well, U ditl, 

Here is Part 11. 

The instructions are exactly the same as tlvey were for Part I. Please do not 
begin until I give the signal 

Remember, first you write your name at tlie top of the page and then proceed 
immediately to completii)g the sentences. When you finish, raise your hand and 
I shall mark the time on your pafKr, 

Ready? BcginI 
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The Sentence Completion Test was not scored; it was interpreted. There 
was little standardization of the interpretations; they were largely individual 
affairs and staff members learned haw to interpret by interpreting, although 
it was clear that the goodness of their interpretations depended upon the 
degree of their psychological insight and the amount of experience which 
they had had with this test or with other projective procedures. Certainly skill 
was acquired by experience in examining many papers, but each member 
of the junior staff, whose responsibility it was to score the Sentence Com- 
pletion Test, had his own approach to its content and his own method of 
interpreting it. Although no general principles were ever formally estab- 
lished, informal discussions of the problems of interpretation led to a cer- 
tain uniformity of technique. 

The task which confronted the interpreter was that of constructing a pic- 
ture of a student solely on the basis of his sentence completions. He may 
have seen the candidate for a few minutes at dinner that evening and with- 
out doubt he had read the meager facts about him as given on his Student 
Information Sheet, but with the exception of this, which was not much, the 
candidate whose sentence completions he interpreted was a stranger to him. 
At least this was the case for the majority of candidates whose sentence 
completions were interpreted the first evening while they were still in the 
classroom and before they were observed in any of the group situations. 

The usual procedure was for the staff member to read through both parts 
of the test, underlining all responses that were unusual or which seemed 
likely to be significant, A number of criteria o£ significance were held 
tentatively in mind during the reading: the uniqueness of the response, the 
amount of material included in the completion, the repetition of any one 
response, and the psychological relatedncss of different responses. Here, as in 
all such material, we looked for the novel and for the repetitious. Two funda- 
mental assumptions were constantly borne in mind even though they were 
held only as tentative hypotheses: (i) the rarer the response of a subject, in 
comparison with the responses given by other subjects to the same item, 
the more significant it is; and (2) the more frequently a response is given 
by any one subject to different items, the more significant it is, presuming 
that the repetition is not the result of perseveration. During the first read- 
ing the aim was to note the significant completions and to detect consistent 
patterns among them, the interpreter thereby gaining a general impression of 
the major trends in the subject’s personality. 

When the underlinings were completed it was a common practice to 
reread the responses and to record them in their appropriate categories on a 
score sheet prepared for this purpose. The score sheet was, in practice, an 
organized note sheet on which the interpreter could record his impressions. 
It was divided into sections, in the left-hand margins of which were printed 
the numbers of the sentences whose completions were expected to shed light 
on a single aspect of personality. In any actual case, of course, the meaning 
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of a completitni might xnakc it Pall into some category other than the 
expected one, anti if so it would be recorded there. Some completions did not 
yield material for any of the designated areas of personality indicated on the 
recording slicct, but that did not necessarily prevent thenn from contribut- 
ing significantly to the picture of ihe candidate, Often a single response 
had meaning for more than one of the rather arbitrary categories. Wherever 
they fitted, the completions were recorded on the score sheet and then the 
data for each categt^ry were coussidcred separately, e.g., one might seek to 
guess, on the basis of vsenicnce completions ahme, what the goals of the 
student were, quite apart from any consideration of Ills family or past 
history. When these brief summaries had been written it was the task of the 
interpreter to organize them into a fuller picture in the form of a tentative 
personality sketch of the candidate. 

For most members of the staff the task of interpreting a sentence com- 
pletion test and writing the personality sketch took no more than half an 
hour, a remarkably short time compared to that rec[uired for scoring the 
Rorschach or the Thematic A])pcrccption Test. 

The personality sketch of the candidate drawn on the basis oE his sentence 
compkdons was never treated as anything more than a very iciitaiive con- 
ception which the interviewer might seek to clicck in his clinical interview 
with the candidate, The test was used solely as an aid to the Interview, and 
no a«cni[>t wtes made to obtain scores cm the variablcsS uptm which it was 
designed to shed light. 

The prestige of the instrument grew steadily as the interpreters and inter- 
viewers gained ex[)crkncc and skill in its use. I’he interviewer read the 
interpretations carefully and noted the suggested significant traits or prob- 
lems to be checked in the Interview, He also examined the individual 
responses to make his own interpretations of the case and io sense for him- 
self the unique flavor t)f the [>ersonality. Fortified with a preview of the 
student gained tlirough a study of his responses, the interviewer was able 
to make more efficient use of the linaiied time at his disposal and not in- 
frequently to confirm significant aspects of a candidate’s personality which 
well might never have been uncovered without a prior study of his sentence 
completions. 

Health Questionnaire,— Akhough all students were examined medically 
before coming to S it seemed wise to investigate the state of health, physical 
as well as mental, of each candidate as a part of the assessment program. 
The reasons for this decision were niany. The phy.sical examination of 
students in Washington tended to be routine and rather superficial, and 
subsequent questioning of candidates at S not infrequently suggested the 
presence of a physical ‘or health problem which was later confirmed by a 
second medical examination. To many candidates the physical checkup in 
town appeared as just another Army examination. Since it had to be made 



StuclenC Name. 


Class S-. 


Please read the following list and mark with an X the answer chat, in your jiulginenc, is 
GENERALLY TRUE ABOUT YOU. DO NOT SKIP. Do not fuss coo much about the exact 

reply. They are only approximations. 

Do you have any particular physical or health problem? Yes Undecided No 


What is your problem? — — ; — 7 ^ 

Have you any physical disabilities that prevent or limit your participation in any type of physical 

activity? Yes No 


If your answer is “yes,” what are these disabilities? 


Have you ever had 

Asthma or hay fever? Yes No 

Persistent tiredness? Yes No 

Allergies? Yes No 

Fits or convulsions? Yes No 

Stomach ulcers? 

Hemorrhoids? 

Marked weight nnctuatioiis? 
Nervous breakdown? 

Yes No 

Yes No 

Yes No 

Yes No 

You have plain headaches 

Never 

Once in several 
months 

z or 3 times a 
month 

4 or more times 
a month 

You have headaches with 
nausea or vomiting.' 

Never 

Once in several 
months 

z or 3 times a 
month 

/\ or more times 
a month 

Fainting spells — (spells in 

which you have passed out). 

Never 

Once in youi 
life 

z or 3 times 

4 or more times 

Almost fainted — (you did not 
pass out, but felt near it). , , . 

Never 

Once in your 
life 

z 01 3 times 

, 4 or nioie times 

Unconscious but not a faint, 
through a blow to the head, 
or for any other reason 

Never 

Once in your 
life 

1 z or 3 times 

4 or more times 

Before you fall asleep, it 
usually takes 

Less than yi 
hour 

}4 hour to I 
hour 

I to X hours 

z or more hours 




After falling asleep, and before 
you are ready to get up and 
dress, you awake 

Not once 

Once 

Twice 

Three tlinc.'j 

You take sleeping medicine or 1 
any kind of sedative 

Never 

Once a month 
or less 

Once a week 

z or 3 times a 
week or 
oftener 

Your sleep may be described 
as 

Very deep 

Deep 

Light 

Very light 

You have scary or frightening 
dreams 

Never 

I or 1 times a 
year 

Once in 1 or 
several months 

Once in i or 
several weeks 

Your eating habits may be 
described as 

You can eat 
almost 

1 or 1 things | 
do not agree 

You have to be 
careful 

There arc many 
things you 
cannot eat 


anything 

You cake bicarbonate 0/ soda 
or an alkali or any other 
medicine for a stomach ail- 
ment 

Never 

Once in x or 
several 
months 

Once in i or 
several 
weeks 

Every day or 
two 

You have had attacks of diar- 
rhea — (running of the 
bowels) 

Never 

Once or several 
times a year 

Once in i or 
several months 

Once in x or 
several weeks 

You take medicine for consti- 
pation 

Never 

Once in i or 
several months 

Once in i or 

Every day or 




several weeks 

two 
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You have been drunk. 

Never 

Once or several 
times in your 

Once or twice 
a year 

Once in 1 or 
several 



life 


months 

You have dixxy spells in ^Yluch 

Never 

Several times 

Once or twice a 

Once in i nr 

objects in tlie room seem to 
be moving 


in your life 

year 

several 

months 

^ have trouble streaking, '.o 
that you stutter t^r ftammer 

' Never 

On rare occa- 
sions 

OccasionaMy 


You have attacks in which you 

Never 

Once or twice a 

Once in i or 

Once in i or 

get cold sweats, your hcait 
beats so hard you can hear ic 


year 

several 

mniuhs 

several 

weeks 

You have attacks in which you 

; Never 

Once or twice 

Once in i or 

Once in i or 

suddenly get anxious or 
frightened 

1 

a year 

several 

months 

several 

weeks 

You have had smothering 
sensations, or shortness tif 
breath not iminedutely fol- 
lowing physical exercise, , . . 

j Never 

1 

1 

Ome (^r twice 

Once or twice 
a year 

More than 
twice a year 

Your friends think of y<Ki as, , 

Always coo! 

Calm most of 

Nervous tern- 

Very tense and 


a Oil c 0 1 - 

lected 

the time 

peranient 

high strung 

Your emocioiul state may he 
described us . . . . 

Steady 

S o ni c w h {V t 
moody 

Ups and downs 

Hither very 

iiigh or low 

You get so discouraged tlut it 

Never 

Onteivv twite a 

Once in i ur 

C)iice in i or 

interferes with your \v<uk , . . 


year 

several 

mouclis 

several 

weeks 

In relation to j^eoplc you meet 
for the first time, you ate. . . 

Ft'iciully 

Shy until you, 
get to know 
them 

Rather svith- 
drawu 

On guard 






Of the ^>eaple you do know. 

Many 

Many friemk--- 

Some or many 

One or two 

you have, 

friends in- 
t i 111 n t 0 
a n cl 
(jtherwiso 

few intimates ' 

friends, few 
intimates 

intimates, no 
others 

You have gone to a doctor. . , . 

Never 

Only when very ! 
ill 

Once or twice 
a year 

3 or more times 
a year 

You have gone to a doctor 
for "nervousness," nervous 
symptom, [wrsonality didi- 
cult/, or personal probJenu , 

Never 

Once or twice 

Tliree times 

More tlun 3 
times 

Your associates consider you.. 

I Unduly ac“ 

Very careful 

A little careless 

Very careless 


tentive to 
details 

about details 

about details 

about details 

In the face of sudden phy,sical 

General ly 

Anxious but 

Prigluened and 

Panicky 

danger you arc, , 

calm and 
W 0 1 1 

controlled 

well con- 
trolled 

poorly con- 
trolled 


In regard to social activity and 

You can'c 

^ Y 0 u prefer 

It's about fdty- 

You much pre- 

solitude 

1 stand hc- 
' ing alone 

1 sociaUctivicy 

1 hut like CO Iw 
alone some- 
1 rimes 

fifty 

fer to f>e 
alone 
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rather hurriedly, there was little opportunity for a relationship of real rap- 
port to develop between the examining physician and the candidates. This, 
combined with the fact that the vast majority of candidates had volunteered 
for the OSS and most of them were eager for an overseas assignment with 
the organization, made them sometimes less than completely frank in an- 
swering questions about their medical history and present physical condition. 
In the more intimate atmosphere at S and in ’the privacy of an hour-and-a 
half interview with a member of the staff, many medical problems hidden, 
or at least not mentioned, at the time of the medical examination were 
frankly and fully discussed. 

Another reason for considering questions of health was that many condi- 
tions which disqualify men for duty overseas may not be recognized by them 
as physical symptoms and are consequently more often and more easily dis- 
cussed with a psychologist or a psychiatrist than with an internist. Perhaps 
the most important reason was that candidates seemed willing to reveal 
themselves fully only when they felt that all aspects of their personalities 
were being considered, and they recognized that health and disease were 
among the most important of these aspects. 

It was only in the intimacy of the Interview that anything like an adequate 
picture of the candidate’s health could be expected, but just as it was possible 
to obtain a preliminary sketch of his personality through paper-aiid-pencil 
tests, projective techniques, and personal history questionnaires, so also was 
it possible to get some idea of his physical and mental health by asking him 
to answer two health questionnaires. 

From the very beginning of S, health questionnaires were given to the 
candidates early in the program as an aid to the subsequent interview. We 
tried many forms of inventory; some were of our own making, others were 
standardized questionnaires. In the last months of S two forms were used. 

The first of these sought primarily to uncover the more frank physical or 
somatic symptoms, though some questions touching upon the more psycho- 
logical and behavioral manifestations of tension and anxiety were also in- 
cluded. This was not greatly different from many other health question- 
naires, but it seemed to us to have two advantages. Its range of questions 
was more adequate than most for the topics which, we believed, needed to 
be surveyed in considering the fitness of a candidate for an overseas appoint- 
ment. Its second advantage was the greater specificity in the alternative 
frequencies of symptoms and experiences which subjects were asked to 
check. Instead of presenting a candidate with such alternatives as 

‘’Never” “Seldom” “At times” “Often” 

it offered him, for example, 

“Never” “Once in several “2 or 3 times “4 or more dmes 
months” a month” a month” 
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This questionnaire was not scored. Standardized norms were never 
worked out; the assessment school came to an end before there had been a 
sufficiently large number of cases or time in which to do so. It is doubtful 
whether, even with these conditions fulfilled, wc would have worked out 
scoring norms, for the main purpose in giving the questionnaire was to 
provide the interviewer with suggestive hints and leads for his meeting 
with the candidate. It was our strong conviction that indices of health based 
upon such questionnaires would have told us little, and more often than 
not would have been misleading. It was our common experience that a 
discussion of a candidate’s check marks with him frequently changed their 
meanings, and it was the meanings of the cliecks (answers) that were espe- 
cially important for assessment. 

In the last months of our program, the second health questionnaire 
given to candidates was Part H of the McFarland-ScItz P’S Inventory, Since 
this form duplicated, with only slight changes in wording, a few of the 
questions in the other questionnaire, the two were not given in succession. 
Interposed between them was the questionnaire on preferences for various 
conditions of work. 

At an earlier date in the program both parts of the PsycluKSomatic In- 
ventory had been used. At first it was scored in the irsual manner, the iwu 
part-scores and the total score being converted into percentiles according 
to tables supplied with the test. When scores for a sunicicntly large popula- 
tion had been acquired, the three raw sctu’cs of the test were converted into 
ratings on the six-point scale used at S and tliroughout the asse.ssmcnt 
program. But soon in practice we found ourselves not paying much attenuon 
to either percentile scores or ratings. Instead, the actual answcr.s t(j the 
specific questions seemed much more significant. Many of them were in 
such a form as to make unnecessary the asking of certain routine questions 
in the Interview, But even more valuable were the leads for questioning 
suggested by an examination of those responses which were shown by the 
scoring weights to be atypical. They often revealed definitely abnormal 
trends. Occasionally the actual response of a candidate could be brought up 
for discussion in the Interview. If, for example, in answer to a question in 
the Interview a candidate denied the frequent occurrence of a certain type 
of experience, he might be asked what he had in mind when, in cliccking 
the Psycho-somatic Inventory, he had indicated that lie **oftcn” had such an 
experience. Frequently significant material was uncovered in this way, and 
if not, then usually a misunderstanding was clarified. 

Eventually all scoring of the P-S Inventory was dropped since the labor 
of scoring was incommensurate with the contribution made by scores to our 
needs and to the use, as preparation for the Interview, to which we came 
increasingly to put the inventory. 

In our experience Part I (Psychosomatic) was less satisfactory than Part 
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II (PsychoneuroCLc), and accordingly the health questionnaire already de- 
scribed was developed and substituted for Part I. Part II, however, sccnaed 
effective in evaluating the more psychological and behavioral indices of emo- 
tional instability and so was retained. 

Work Conditions Survey.— The great variety of jobs for which candidates 
were assessed, and the heterogeneity of the conditions under which they 
would work if given their projected assignments, made it necessary to 
ascertain as accurately as possible the conditions of living aiul of work to 
which candidates could adjust and in which they could function effectively. 
This was a topic which could be discussed in an interview but it was also 
one which there was reason to believe could be explored in a preliminary 
manner in a questionnaire. Of course, here, as in all questionnaires, there 
was the possibility of falsification of answers; a candidate can alvvay.s give 
those answers which he believes will get him the job he wants if he wishes 
to do so. Against such misrepresentation there is no perfect defense. Even 
with the best intentions to report hoiiesdy and accurately, a person may 
misjudge or not know at all his capabilities of adjusting to new and difficult 
conditions of work. The best defense against both witting misrepresentation 
and unwitting misjudgment of psychological fact is the true insight of the 
skillful clinician. It was, then, the task of the staff member in his interview 
with a candidate to assess the validity of the candidate’s answers to all 
questionnaires. The answers given by a candidate to questionnaires were 
never taken as statements of fact, but only as crude indications of the kind 
of person one might meet in the Interview. The hypotheses yielded by the 
techniques of the first evening were subject to later checking, however, 
not only by the interviewer in his meeting with the candidate but also 
by every member of the assessment staff in every observation of the man 
made throughout his stay at S. Statements made by the candidate in the 
Interview might contradict his checks on the Work Conditions Survey, and 
his adjustment, good or bad, to the conditions of living and working at S 
might belie them even more clearly; yet to have from each candidate early 
in the program an indication of ihe conditions of work which at one extreme 
he would welcome and at the other extreme he would emphatically reject 
was decidedly helpful. 

The Wor\ Conditions Survey listed forty-three different conditions that 
do exist (or can exist) in any job. The candidates were asked to rate their 
own reactions to each condition on the basis of the following rating scale: 

r. Highly desirable — exactly what you want. 

2. Desirable. 

3. Acceptable — -it doesn't make any difference one way or the other. 

4. Difficult to accept, though something to be put up with if necessary, 

5. So difficult you doubt if you could manage it, 

6. It would make a job impossible — ^you would refuse it. 
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Student Name: — 


— Class S- 


I, Monotonous work i i 3 5 6 

■L. Months of idleness 1 1 - 315 ^ 

3. Irregu 1 11 r hours i x 3 4 5 6 

4. A strict harsh boss i i 3 4 5 6 

5. Very routine work i 13456 

6. Periods in which you have to work all night. . . t x 3 4 5 6 

7. Stuck away somewhere with little or no social 

contact i 1 3 4 5 6 

8. Desk work exclusively i 13456 

p, Always under supeevisian x 1 3 4 5 6 

10. No one CO calk to i 13456 

11, A lot of paper work 1 2. 3 4 5 6 

II. Great physical danger. * i 13436 

13. Full of excitement i 13456 

14. A large office, many people^ desks close together, I 13456 

15. Nothing routine, you never know what they’ll 

ask you to do next i 1 3 4 5 6 

16. V/ork requires a lot of social activity ,x 1 3 4 5 6 

17. Climate monotonously hot and humid i 13456 

18. Climate in which there is prevailing zero 

weather and bleak landscape i 1 3 4 5 6 

19. Work requires a great deal of vespemsibility i 13456 

10. Work requires much initiative i 13456 

11. A job in which everything depends on your 

decisions i 13436 

11. Poor food X 1 3 4 5 6 

13. Office job, regular hours, well-defined clerical 

job 1 1 3 4 5 6 

2.4. Job requires great physical endurance i 13456 

15. Climate with constant rain i 1 3 4 3 6 

16. Working in close relaciorts witli Negroes i 2. 3 4 5 6 

17. Working in close relations with Orientals .1 1 3 4 5 6 

18. Job requires intimate personal interviews with 

every variety of individual 13456 

19. Working exclusively with women i 13456 

30. See only men for long periods of time 1 1 3 4 5 6 

31. Dirty surroundings i 13456 

31: An area in which syphilis is common x i 3 4 5 6 

33. An area in which malaria is common i 1 3 4 5 6 

34. An area in which tuberculosis is common i 13456 

35. An area in which a large majority of people tend 

CO become alcoholic i 1 3 4 5 6 

36. Advising people about their personal difficulties, I 13456 

37. Work requiring the highest degree of acciirncy 

and fine detail i i 3 4 5 6 

38. Work which often requires the meeting of dead- 
lines,. 13456 

39. Selection of fwrsonnel .x 1 3 4 5 6 


40. Work involving abstract and theoretical fonmi' 


lations— the kind of thinking done by philos- 

ophers . , . . i x 3 4 5 6 

41. Work requires practical intelligence and quick 

decisions 13456 

41. Work requiting slow deliberate, cautious, lei- 


surely thinking. , 
43. Frequent "snafu” 


113456 


COMMENTS 
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Alter candidates had checked this survey— there was no time limit, but 
candidates seldom took more than ten minutes to complete it— they were 
given the second health questionnaire (Part 11 o£ the P-S Inventory) and 
then presented with the second part of the Sentence Completion Test. By 
the time the candidates had completed these it was usually nine o’clock, and 
since they had been working without a break for two hours, tlicy were given 
a fifteen-minute intermission. Reminded of the invitation to raid the icebox 
in the evening, most of them proceeded forthwith to do so. 

After the break, the candidates were given three forms to fill out, but 
since none of them was timed, they were presented in a group to the men, 
who were then left free to work at them at their own pace. The only re- 
quirement was that they all complete the procedures in the same order, first 
taking a Vocabulary Test, then filling out a Personal Plistory Form, and 
finally answering a Projective Questionnaire. 

Vocabulary Test.— -Many candidates were handicapped in the assessment 
program, especially in tests of intelligence, by their foreign background and 
by their poor mastery of the English language. To estimate the degree of 
this handicap a vocabulary test was given to all recruits the first evening, 
but there were other reasons also for including such a test in the program. 
Provided an individual is tested in his native tongue, his score on a vocabu- 
lary test is known to be a good indication of his general intelligence. Tests 
of vocabulary are especially useful in appraising the level of intelligence 
of older men who may be handicapped by such speed tests as the Otis. 
Finally, they can give some indication of a subject's verbal facility, a factor 
of the greatest importance in propaganda activities, the ability for which 
we had to test in many candidates. 

The vocabulary test used in the assessment program was composed of 
fifty items borrowed from the American Council on Education Psychological 
Examination (ACE), the Institute of Educational Research Intelligence Scale 
CAVD, and the At well- Wells Wide-Range Vocabulary Test, It was a 
multiple-choice test with four alternatives for each item. 

Personal History Form. — Of all the material gathered from the candidates 
in the first evening, none was more important than their personal hi.storics, 
the salient facts of which they were asked to record under X conditions, in a 
booklet especially prepared for this purpose. 

The Personal History booklet was designed in such a way as to make it 
convenient for the interviewer to record in appropriate places therein the 
material he obtained from the Interview. When the booklet was opened, 
the questions put to the subject always appeared on the left-hand page only, 
together with plenty of space for writing his answers. When a subject 
had filled out his Personal History booklet the interviewer could study it, 
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make notes on the margin, take it Co the Interview with him, and then use 
• the right-hand blank pages for recording data gained there. 

Several considerations entered into the selection of questions for inclusion 
in the Personal History blank. Since the candidates would be working on it 
during the evening of their arrival, after they had taken a number of paper- 
and-pencil tests, it was thought wise to make the blank as short and simple 
as possible. Yet to meet the requirements outlined above, sonic aUention 
had to be given to various aspects of the nian\s background, history, and 
present situation. The task, then, was to make every question amni for the 
most, and a great deal of cxperimcniation went on — during which ques^ 
tions were put in and taken out and reworded and reinserted — before a form 
was hammered out that all the staff could regard as reasonably satisfactory, 

There had to be good reasons for finally including a question. And the 
reasons were always the same: in the first place, the question included was 
one which on one theory or another promised to yield material that was 
significant for personality and, in the second place, there had to be evidence 
from experience to show that the question actually did, reasonably well, what 
it was supposed to do. 

A glance at the Personal History blank, given on pages 84 to 89 without 
attention to the spacing that held for the original, will slu>w that most of the 
old “stand-bys^’— 'that is, topics and questions which have turned up time 
and again in application blanks and personal data sheets— arc very -much in 
evidence. There is a great deal of agreement among psychologists today as 
to what are the major determinants of personality development. Though 
they would differ in what they regarded as most Important, few psychol- 
ogists would want to leave out any of the following; national or racial back- 
ground, socioeconomic status, personalities and interests of the parents, in- 
terpersonal relations within the family, traumatic events and fixations of 
early childhood, educational influences and experiences at school, vocational 
history, military record, marital history, present interests, sentiments and 
preferences, and health past and present. 

None of the questions was very difficult or profound, and an effort was 
made to leave out everything that seemed likely to embarrass, frighten, or 
annoy the candidate. These more personal or emotionally loaded matters 
could be taken up in the Interview. 

Candidates were allowed as much time as they liked to complete the 
Personal History form. Some finished in an hour; others had to be asked 
to bring it to a close after working three hours; the average time was 
approximately one and a half hours. These differences in amount of time 
spent on the Personal History corresponded rather closely to differences in 
the amount of material obtained — and these clifFcrcnccs, as it turned out, 
were significant intimations of the subject's conscicntiousne.ss and motiva- 
tion. But the differences were most largely due, as it seemed to us, to varia- 
tions in the degree of the subiecr’s i-:- * 
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PERSONAL HISTORY 

The personal questions which you arc asked in tliis form (under “X" conditions) should 
be answered candidly and completely. All information which you may give us is confidential, 
and will be so treated. Other than for your true namc> security regulations for this area are 
suspended. 


STUDENT NAME; 

Class: 

Marital Status (check);' Single 

Place of birth: 

Present citizenship: 

Religion; 

I am of the ist and 3rd or later 
(Encircle the appropriate number.) 


Age: Sex: 

Date of Birtli: 

Married Widowed Divorced Separated 
D.ate of immigration: 

Date of naturalization; 

Politics; 

generation of my family to be born in America, 


ABOUT YOUR FATHER: Age if living; Age at death; Your age .at his death; 

Place of birth; Citizenship: 

National origin of his family: 

Education: 

Occupation (5): 

Interests and Recreations: 

Politics: 

Religion: 

What sort of person is (or was) your father? 

ABOUT YOUR MOTHER; Age if living 
Place of birth; 

National origin of her family; 

Education: 

Occupation (s): 

Interests and Recreadons: 

Politics: 

Religion: 

What sort of person is (or was) your mother? 


Age at death; Your age at her death: 
Citizenship: 
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Have youf parents ever been divorced or scpuratccJ? If so: Wliai was your age at iJic time? 
With which parent did you live afterwards? 

Give other details. 


about any step-parents, l-OS'niR PAREN’l'S OR ANYONE ELSE WHO TOOK. 'i'HE 
PLACE OF A PARENT FOR YOU. ([f more than one, give same information on opjvositc 
page.): 

licr 

Age If living; Age at dcatli! Your age at his death: 

Place of birth: Citizenship; 

her 

National origin of his family; 

Education; 

Occupation (s); 

Interests and Rccreation.s; 

Politics; 

Religion; 

What .sort of person is (or was) lie (or she)? 


Which parent do you think liad more to do* with your becoming the kind of i)crsori you arc? 


To winch parent did you feel closer at the ages of 

6 10 iC) 2 $ now? 


Which parent exercised the discipline in your family? 


Give the ages of all brothers and sisters in relation to your own: Thus, if you have or had a 
brother 5 years older and a sister 2 years younger titan you, write B-h^, S-~2; if any have died, 
indicate by inclosing in parentiteses; 

B B B fl B B B 

s s s s s s s 

What major satisfactions did you derive from your relationship with your brothers and sisters? 


What kinds of frictions existed in die family? Has any member of your family ever brought 
embarrassment or unpleasant notoriety upon the rest of you ? 


What other people (relatives, guardians, friends, etc.) influenced your development? In what 
way? 


At what age, approximately, did you stop wetting the bed? 
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Did you ever: 


bite nails? 
have nightmares? 
stammer? 

Were you considered a nervous child? 


suck your thumb? 
have temper tantrums? 
walk in your sleep? 
talk in your sleep? 


In what part of die United States did you spend the major part of your childhood? 


Did you live in a city? Small town? 


Farm? 


Adult life? 

What foreign travel have you had? 


her 

ABOUT YOUR WIFE (OR HUSBAND): Age if living: Age at death: Your age at his death: 
Place of birth: Citizenship: Date of marriage: 

her 

National origin of his family: 

Education: i 

Occupation (s): 

Interests and Recreations; 

Politics: 

Religion; 

What sort of a person is (or was) he (or she) ? 

Write a brief marital history, including date of marriage, ages and sex of children, also 
separations, divorces, remarriages. 

How is your health? 

List in chronological order, with approximate ages, all illnesses, operations, and accidents. 


How often and under what circumstances do you drink alcoholic beverages? 

As a result of drinking have you ever (i) been arrested? (2) lost your job? 

(3) publicly disgraced yourself? (^) damaged your health? (5) embarrassed or huit 
your family? 
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List evcr^ time you have been arrested for any cause. 

Date Charge Outcome 

Have you ever brought suit or been sued at law? (Give details) 

List kinds of schools, names of colleges and universities, dates of attendance, major fields of 
study. 

INSTITVTION D^TE OF ATTENDANCE MAIOIi STUDIED 

Was your school record Poor Average Good Excellent? (encircle) 

Was your college record Poor Average Good Excellent? (encircle) 

What were your best subjects? 

What were your worst subjects? 

Any fellowships, honors, scholarships? 

Extra-curricular activities and achievements? 

What sports have you participated in? What teams have you played on? Have you ever been 
captain of a team? 


Comparing yourself with others of the same age and sex, rate yourself on the qualities listed 
below, Using the foWowing scale; Very inferior, Inferior, Average, Superior, Very Superior, 


1. Agility I. 

2. Endurance 2. 

3. Speed 3. 

4. Physical strength 4. 

5. Physical courage 5. 

(Daring) 


What recreations and hobbies other tiian sports have you engaged m? 


Were you ever suspended or dropped from a school or college for academic or other reasons? 
Describe in detail. 


What public speaking have you done? 
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What books have you rend and liked best? 

What magazines do you ordinarily rcsad most regularly? 

What kinds of clubs or organizations do you belong to (vocational, social, political, religious, 
etc.) ? 

What oflices have you held in liic clubs or organizations of wliicli you have been a member? 

Did you hold any jobs in scliool or college? Describe in detail. 

What do you plan to do after die war? 

Draft status (if male civilian) and reasons: 

If you arc a member of the armed services 
Which one? 

Date of induction; 

hist of ranks or grades, special duties, and responsibilities in your milUary duties' and dates for 
each, 

Sfaiion Ratt^ DttlUi Dates 

or grade 


If you have ever been discharged from any branch of the armed forces, state the type and 
cncurnstances of the discharge. 


inclination for paying attention to his own thoughts, feelings, and attitudes, 
and for being inquisitive about their sources. Some told us much, others 
very little. At one extreme there were the constricted personalities who 
answered with single words or pinched and barren phrases at most, and at 
the other extreme the exuberant and expansive individuals who repeatedly 
overflowed in their writing onto the blank pages reserved for the inter- 
viewer’s notes. In the time of one man’s answers there vvas no mistaking his 
depression, while In another’s the hypomanic temper was equally manifest. 
The awkwardness of style, the hcautitul phrasing, the dull reporting, the 
bright and witty answers— all these gave a picture of the candidate long be- 
fore he was seen in situations or in the privacy of the Interview. To have 
read a man’s Personal History with care was to know a lot about him. 
There was no better way to prepare oneself for an interview with him. 
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Projective Questionnaire.— A separate unit, inserted into the Personal 
History form, was a sheet on which twelve projective questions were asked 
of the candidate. These questions ranged widely: 

I. It seems chat no matter how careful we are, we all sometimes have 
embarrassing moments. What experience makes you feel like sinking 
through the floor? 

3. What things or situations are you most afraid of? 

3. What kinds of things do you most dislike to see people do? 

4. If you had a large fortune and few responsibilities, how would you spend 
your life? 

5. If you were (are) a parent, what things would you try most to teach your 
children? 

6. What might push a person into a nervous breakdown? 

7. What would you most like people to say of you after you have lived your 
life? 

8. What moods or feelings are the most unpleasant or disturbing to you? 
How often do you have them? 

9. Everyone has bad dreams or nightmares at some time or another, such as 
after overeating; what would be the worst dreams to have? 

10. If you were (are) a parent, what things would you try to guard your 
children against most carefully? 

11. What great people, living or dead, do you admire most? 

12. What was the greatest lack in your childhood? 

These questions might well have been asked in the Interview, but to 
have the answers to the questions ahead of time was in many cases to know 
something about the candidate’s emotional life, something of his most im- 
pressive experiences, something of his attitudes and sentiments, and, know- 
ing these, to be better prepared to interview him. 

The term “projective” is used, for want of a better term, to describe 
the fact that the subject, unless he was psychologically sophisticated, rarely 
saw the implications of these questions, and the fact that the answers to them 
usually were not to be taken at their face value but regarded rather as 
responses which could be interpreted— interpreted in the light of the total 
setting in which they appeared or in the light of other facts about the sub- 
ject’s personality. There was a great deal of theory behind each question — 
theory which determined its selection and guided the interpretation of the 
response. For example, the question, “What kinds of things do you most 
dislike to see people do?” was based on the notion that the tendencies which 
a person dislikes to see another express are sometimes the very ones which 
he has tried to suppress in himself. But not necessarily. The responses have 
to be interpreted. 

It would be difficult to say which question was most revealing; that varied 
from candidate to candidate and possibly, too, from interviewer to inter 
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viewer, depending upon what he saw in each answer. A projective test for 
a subject is always to some extent a projective test for the psychologist who 
interprets it. The value of such tests lies not in the quantitative data which 
they yield but in what they reveal to a sensitively and critically perceptive 
examiner. One must always count on the possibility of projection in inter- 
preting the results of any projective test; yet not to use them for that reason 
is to deny oneself insights which can hardly be gained so easily or so 
quickly with any other procedure. This is not to claim that every finished 
projective questionnaire was revealing; many of them were drab and banal, 
indicating little or nothing about their authors. They stirred nothing in our 
minds, supplied us with no hypotheses which could be tested in the Inter- 
view. 

To consider but one question, “What moods or feelings are the most un- 
pleasant or dlsturhing to you?” the frequency with which replies to it pro* 
vided a key to the candidate’s personality, for example, his frustrations, his 
feelings of inadequacy, his loneliness, or his homesickness, was striking. Ii 
was common to find such frank answers as, “Loneliness for my parents,” 
“Thinking perhaps there’s something I have missed in life or failed to do/' 
“Feeling sorry for myself,” or “Having someone dislike me ” But, of course, 
there were other answers that told us nothing, 

Reading the candidate's answers frequently gave us some impression of 
the manner of man with whom we had to deal But more than this, the 
projective questionnaire gave a picture of the man which could be integrated 
with the factual material in his Personal History and with material from 
his other written products into a sec of impressions and hypotheses regard- 
ing his personality which made it possible to use the time devoted to inter- 
viewing to maximum advantage. 

During the latter part of the evening, while writing their Personal His- 
tories, candidates were twice called from the classroom, first, singly, to have 
their pictures taken, and later, in groups of two or three, to be given a test 
of observation and inference which was known as the Belongings Test.^ 

^In content, tliis tc$t overlapped the Brief Case (at first given on the morning of the first 
full day, but later dropped from the program), and the Murder Mystery which the candidates 
were asked to solve on the last day. Together these three tests created w world of fantaiy 
into which the candidates were introduced at S. This fantasy was built around a mythical 
psychologist-consul lant to Station S who had hurriedly departed from the area, leaving 
behind him a number of personal effects which it was the candidate's task to examine in 
the Belongings Test. As the candidates discovered later, this notorious psychologist was 
involved in nn extramarital affair and had become the dupe of a group of spies who lived in 
the ncighborliootl of the area and were trying to penetrate if. As will be dcscribcxl below, 
this climate of fantasy, laid over S> into which the candidates became drawn, played a most 
important role in the development of their morale in the assessment program. The scheduling 
of the Belongings Test in the first evening was important since it was clear that the sooner 
the candidates were introduced into this fantasy world the more c/fcccivc that fantasy would 
be as a morale-builder. 
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Belongings Test.— For this problem, the candidates were conducted to a 
room in the basement where, before entering the room, they were given the 
following instructions: 

This is a test of your ability to observe and draw correct conclusions from 
your observation. This room was occupied several montlis ago by a man who 
was a guest here for several days. On his departure he left a number of his 
things, a number of belongings behind him in the room, planning at the time 
to return. We have collected these and laid them out so that they arc all in 
plain sight. Your task is to examine them to try to size up the man, to learn all 
you can about him, what he was like, in any respect. You will have four minutes 
for the examination, and then you will be asked to answer some questions about 
this man. You will go in as a group, but you will work individually. Please do 
not talk to one another during the examination or make any comments on your 
observations. You may pick up things to examine them if you wish, but please 
replace everything exaedy as you found it for the other persons in the group. 
Any questions? 

The room into which the candidates went was set up as a bedroom. 
Twenty-six items, among them articles of clothing, written materials, news- 
paper clippings, time table and ticket receipt, and so on, were placed openly 
on the bed, chairs, and tables. 

The candidates were allowed to remain in the room for the allotted four 
minutes, while the staff member who was also present noted in as much 
detail as possible the manner in which they examined the objects. 

They were then taken to another room where they were asked to answer 
thirty-six questions about the man whose belongings they had just examined, 
These were questions of inference about the mythical figure— for example, 
questions concerning his age, marital status, weight, occupation, color of hair 
and eyes, residence, for some of which there was clear evidence, for others 
doubtful evidence, and for still others no evidence at all. The cask of the 
subject was twofold: (i) to answer the question, i.e., to draw inferences 
from what he had seen, and (2) to indicate the due or clues which led 
him to each conclusion. He was explicitly directed not to answer any 
question for which he had found no evidence. The raw score, computed by 
adding the number of correct inferences and the number of correct clues, 
was converted into a rating on the S basic six-point scale and recorded as one 
measure— others would be obtained later— of the candidate’s ability to ob- 
serve and draw correct inferences. 

This was the program of the first evening at S, It was a full one, It 
kept the candidates busy from seven o’clock until nearly midnight. In rare 
cases, where a man for one reason or another had not finished by 12:30, 
he was interrupted, and it was left to his interviewer to obtain the mate- 
rial which the man had not had time to record, 
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There is no doubt that this was a cliflicult and tiring evening. It was, 
however, extremely valuable from our standpoint for it yielded a great 
deal of badly needed inforination about the candidates at the very beginning 
of the program. And, tiring though it was for the candidates, it served 
for them, too, a most important function. Its value as a builder of morale 
for the organization and as a first experience determining the attitude of 
the candidates toward the assessment program was crucial Rejieatedly 
subjects reported being very much impressed by the intensive scheduling 
of the first evening. Their reaction was to £cel that any orgnnlzation that 
took such pains in the selection of its personnel must be an unusual one, 
and if they were accepted by it after such testing, then they too must be 

FIRST DAY 

The first full day at S, like those that were to follow, began with break- 
fast at 7:30, but even before this, while the candidates were waiting in the 
living room, eacli had been given a schedule of his appointments for the day. 

Breakfast on this day was usually a livelier meal than dinner the night 
before. Much of the initial tenseness had worn off. By now each man was 
talking about himself in terms of bis cover story, and most of them appcarcil 
to be enjoying the experience. There Were always some who were not yet 
at ease In their new roles. 

Many wanted to know about Mr. Weeks, whose belongings iht7 bad ex- 
amined the night before, and they were given aitswers, for we tnadc it a 
point to discuss with recruits any test they liad taken, once it was all 
over. We did not tell them how they had dune, but where there was no 
reason to believe that discussing tests witli them would induence ihctr per- 
formance on later tests, we talked about them freely. It seemed to us 
important to do this after all tests, but especially so after siuuitions which 
were decidedly unpleasant or in which the candidates were made to endure 
extreme frustration. It was essential in the assessment of men for overseas 
assignments in time of war that we see them in stressful and upsetting situa- 
tions. Yet it was clear that the success of the program dcpeitclcd ctn our 
ability to ensure their cooperation and their best efforts in all test situations. 
A special effort was therefore m«ade to cli.spcl the disturbing eflects of certain 
procedures. We made it a principle, after each upsetting lest, U\ [U'ovidc 
an opportunity for catharsis l)y having the candklacc talk the situation over 
with a member of die staff, who tried to help him get over his feelings (d 
failure and restore his self-confidence. Furthermore, a discussion of each 
procedure among the men themselves, once they all had passed through it, 
was permitted and encouraged; and these discussions, often piirtici[Kitcd in 
by staff members, had a greatly relieving effect. A playful expression of 
aggressions against the staff and the procedures was encourajjed bv staff 
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members, who entered into the game with frank enjoyment. Through this 
process of socialization and release the disquieting episode soon became a 
good joke to be enjoyed in retrospect, and the attitude of apprehension with 
regard to what was coming next was replaced by one of pleasant anticipa- 
tion. But more than any special devices for dispelling the after effects of 
upsetting procedures, the cheerfulness and good humor of the staff members, 
their obvious enthusiasm in their work, their enjoyment of the company of 
each other and of the candidates, and above all their constant interest in 
the candidates themselves, were the important factors in inducing the same 
spirit in the candidates and in making most of them feel, not like psy- 
chologists’ guinea pigs, but like full-fledged members of the assessment 
program. 

And so this first morning candidates talked about Mr. Weeks and the 
things they had written about him. They argued as to whether his eyes 
were blue or brown, whether he was married, whether the whiskey he had 
left behind in the glass on his bedside table was an indication that he had had 
a cold or a sign that he was an alcoholic. And so in good-spirited disagree- 
ment and interest in the program, the candidates began their first full day, 

Breakfast over^ the recruits assembled at 8:20 in the classroom. The indi- 
vidual schedules which had been given each man were explained, and the 
importance of meeting all appointments on time was stressed. 

Instructions for Terrain Test. — Candidates were told that at noon of the 
following day their abilities to observe the terrain of S and its buildings 
and, from their observations, to infer what the history of the farm had 
been, would be tested. To aid in this task, a map of S was given each 
candidate. These they could carry with them as they explored the grounds, 
and they were free to make whatever notes they wished; but at the time 
of the examination they would have neither their notes nor their maps. They 
were specifically instructed to discover what every lettered object on the map 
represented and to orient the farm and its buildings to the points of the 
compass. The assignment was to be carried out in their free time and to be 
treated as an individual problem, each man exploring the grounds by 
himself. 

Immediately after the Instructions for the terrain test had been given, the 
candidates scattered, some with maps In hand to explore the terrain, others 
to the third floor of the main house for their clinical interviews, a group of 
them to the main hallway where they gathered before being taken by their 
staff team to engage in two outdoor situational tests, the Brook and the 
WaU. 

The Brook. — In the execution of this problem the candidates, in a group of 
four to seven members, were taken to the brook which ran through the 
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estate.^ This was a shallow, narrow, quiet stream, the banks of which were 
about eight feet apart. On one bank was a heavy rock, on the other a log. 
There were trees on both sides of the brook and scattered around on the 
side where the group stood were a number of boards, none long enough 
to reach from bank to bank, three Icngilus of rope, a pulley, and a barrel 
with both ends knocked out. 

Having come to the brook, the candidates were instructed as follows: 

In this problem you have to use your imagination, Before you, you sec a raging 
torrent so deep and so fast that it is quite impossible to rest anything upon the 
bottom of the stream, lire banks arc sheer, so it will be impossible for you to 
work except from the top of them, 

You are on a mission in the field, and having come to this brook you arc faced 
with the task of transporting this delicate range-finder, skillfully camouflaged 

2 It was our custom to divide classes of candidates into subgroups in order the more 
easily to observe individual behavior and the more adequately to perform our (ask of assess- 
ment. It was too much to expect that all members of the staff could get to know every 
candidate equally well when the usual number of men in a cUsSs was eighteen. To have, tried 
ID observe Uic behavior of all eighteen recruits in various group tests would have led only 
to a chaos of impressions. For these reasons wc divided S classes into subgroups; three .sub- 
groups of six for a class of eighteen; three subgroups of five for a class of fiftern, and so fonlu 
To each subgroup was assigned a team of three staff members who were priniurily irsponsible 
for the assessment of the candidates in their group. 

In assigning candidates to a subgroup, primary attention was paid to the proppued assign- 
ment, the age, and the educational status of die men, since it was our desire to h.wc each 
group as homogeneous as possible with respect to those factors, With larger classes we were 
usually able to form three rather distinct groups? (i) men recruited for sabotage o(}cf.uion5 
behind enemy lines — young, atidctic men, as a rule, many (»f whom had not gone to college; 
(a) men recruited for secret intelligence work-in early r\-ilddlc age, generally, with a better 
education and less athletic ability than those in the fust group; (3) men recruited for prop.\- 
ganda activities — m the early days of S, many of these were huif^rSs frum Europe, aru*>iically 
inclined, and belonging to the '’verbal typed' Tliis group was likely to he more heterogeneous 
than the other two. To it would also be assigned men who hntl been selected as administrators 
and those who were to work In the field of social research and analysis. 

There would have been some advantages in adopting the opposite policy, in making each 
subgroup as heterogeneous as possible, but it seemed, on the whole, better to bring together 
the kind of men who would work together overseas. Then, too, with homogeneous groups 
the danger that a man would be overrated or underrated by the staff because he stood out 
in cither a positive or negative way from his tcamrrv;\tes was mininn7.cd. 

The team of three assigned to each subgroup of candidates w.is composed of one junior 
and two senior staff members (each of whom acted as interviewer of half of the men in the 
group). Those who were primarily responsible for recording tlic behavior of candidates 
in the various situational tests were designated as "situiilionists/* in contrast to the "inter* 
viewers," This distinction in names, however, did not mean that the interviewers saw candidates 
only in the interview or that only the siuintionisis saw them operating ns a group. All staff 
members observed nil the members of their subgroup in nil diuntional tests. This inc.int that 
each candidate was rated indepcnilcntly by at least three members of the staff on every 
situation, and in some sUu;\ lions where all candidates and all staff member .s were brought 
together, every candidate was rated by every staff member. 

The independent ratings given by members of any one staff team were always subse* 
qucmly discussed in conference and converted to a final rating agreed to by nil. (The details of 
staff work and the procedures by which final ratings as well as the final reports on candidates 
were prepared arc described at length in Chapter IV.) 
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and persistence in applying himself to the task. During the discussion of 
possible plans, Energy and Initiative could be seen in a recruit's offering 
various suggestions, sliowing an interest in the ideas of others, and work- 
ing actively with the group for u final plan of action. Once die work got 
under way, it was manifest in a candidate's contribrning energetically to 
the physical work, volunteering for the more cliflicult or more unpleasant 
tasks and actually doing them, suggesting solutions as new problems arose, 
and maintaining a high level of interest in carrying the project through to 
the end. The candidate with high energy and initiative was the man to cross 
the stream, to climb the tree, to rig the rope, to fasSten tlie log with rope 
whether it was soft and pliable or fro'/cn stiff or covered with mud; he 
was ready to propose new ideas when they were needed and to direct others 
in their execution, On the other hand, the recruit with low initiative and 
energy said little or noihing in the period of discussing [dans, took little or 
no part in the actual doing of die work, made sliglit effort to cooperate 
with his associates, and evinced little interest in their efforts to solve the 
problem. 

Effective Intelligence, It seemed to us, was displayed in many forms 
at the Brook: the insight of the candidate into tl\e general requirerneius of 
the problem; his sjicccl and resourcefulness in meeting those demands; the 
relevance and usefulness of his ideas and suggestions; his evaluation of the 
proposals (jf others; his ability to sec certain physical relationships (the fact, 
for example, that while no single Imard was long enough to bridge the 
stream, two tied together would serve this purpose); his ability to solve 
the mechanical proldems involved in the situation (rigging the ropes and 
pulley, tying knots, securing the hoards of tlic bridge); and so forth. The 
recruit of low intelligence showed none of these charactcM'istics, Instead, 
he made inappropriate or inadequate suggestions, persisted in ideas that were 
not feasible, and was incapable of implementing the plans of others wdth 
the available materials. 

The variable of personality designated by \is a.s Social Relations was to 
be observed in all that a candidate did in relation to his fellows. Ty[)ical 
positive manifestations of good social relations at the Brook were .seen in 
the willingness of a recruit to work with his groiqi for a common end, 
tactfulness In criticizing or o|>pf).sing the ideas of oilicrs, tlic disposition 
to take criticism or rejection of his own ideas gocHhnaturedly, a rclial>lc 
sense of humor, warmih, friendliness, and insight into others. A candidate 
with good social relations was usually an active participant in the groups, 
eager to cooperate, and obviously liked and rcspecrccl by his associates. 
Among the indices of good social relations was included a ready and warm 
response of his teammates to him. There were fully ns many ways in 
which a candidate could manifest poor social relations; he could withdraw 
from the group and work by himself, or not work at all; he could be hostile 
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or annoying^ irritable or caustic, surly or tactless in his dealing with his 
teammates. 

Of all the variables of personality rated at the Brook none was more inter- 
esting to observe or more varied in its appearance than Leadership. Indices 
of this trait were taken to be a man’s initiative and forccfulness in guiding 
others in. the solution of the problem; in his organizing of the group into 
an elective working team; in his diplomatic planning of the solution, 
judiciously combining ideas from several sources; and in his skillful direct- 
ing of the proceedings in the final execution of the plan. The good leader 
was the one who commanded the respect and following of others, who had 
the ability to organize their ideas into a plan, and who was forceful enough 
to guide his colleagues to the completion of their task with a minimum of 
friction and a maximum of cooperation. On the other hand, a poor leader 
might be a man who was simply content to take orders from others, a man 
without interest in leading, or a man without forcefulness or initiative. But 
leadership was not always so simple as this. 

Sometimes the group formally elected a leader at the start and retained 
him to the end despite his demonstrated lack of competence. More often 
some man would assert himself by proposing a plan of action or by asking 
each man for his ideas and thus taking charge of the discussion. If he 
succeeded in gaining the lead in either of these ways, he might continue to 
guide his teammates from then on, even though his ideas were faulty and 
his plans poorly conceived, But a man who took the lead at the beginning 
was not always directing things at the end, and it was just these cases in 
which the leadership role changed that were particularly interesting. Some- 
times a man who started by guiding the discussion lost his place when the 
work began to one who was more adept in manipulating physical objects. 
On another occasion a man would lose his leadership when a teammate 
proposed a new idea that was adopted by the others, who then turned to 
this second man for direction in its execution, If it worked, the group was 
apt to regard him as the leader from that point on. Not infrequently two 
or more men competed for leadership throughout the task, acknowledgment 
shifting from one to the other as they varied momentarily in resourceful- 
ness or power. But it was not always the most assertive individual who 
dominated the enterprise. He might try for leadership and even hold it for 
a time, but the group might reject him eventually in favor of a quieter mem- 
ber who had made suggestions that had really worked. It was clear that 
leadership assertion and leadership efficiency were two different things, 
though, to be sure, a single individual could manifest both qualities in high 
degree. 

The quality of leadership at the Brook was almost infinitely varied, 
There were those who pitched into the work and did much of it them- 
selves, setting the pace and the direction of the solution by their own 
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actions, encouraging the rest to work with them. Others directed from a 
distance, giving orders without soiling their hands. Usually, however, the 
leader was close to the work; rarely did a man who stood aside succeed 
in maintaining his authority. Still others shared the responsibility, selecting 
one or two ’‘lieutenants’' and collaborating with them in directing the 
affair. In some groups the division of role was such that it was difficult 
to designate any one person as Icadci'. 

While Physical Ability was a variable to be rated at the Brook, there was 
seldom a good o[)portunity to measure it with certainty. Only a few indica- 
tions of it could be seen: a man’s strength in lifting and manipulating the 
boards, log, or rock, or in pulling on a rope; his skill in crossing hand-over- 
hand on the overhead cable, or balancing on a precarious bridge. 

Not only were there individual differences to be observed but also marked 
group differences. Some groups worked like busy beavers, moving so fast 
and skillfully and haniioniously that there was little need for verbal com- 
munication or even direction from a leader. When the problem was solved 
—usually quickly — it was dhlicult to know wlio had done what. Other 
groups were disrupted l)y argument and disagreement, everyone competing 
for the lead and none willing to do the dirty work. There were verbal 
groups who talked and talked with little result; there were sluggish groups 
and energetic groups, 

In the program at S one hour was allotted for the two outdoor tasks, 
the Brook and the Wall, Something of the range of ability among groups 
in dealing with such problems is shown in the fact that, though the fastest 
time for the Brook was four minutes, there were groups who after an hour 
had not yet succeeded in transp(>irting the rr>ck and the log over the stream. 

The Wall. — Immediately following their completion of the Brook prob- 
lem, the group was taken across a field to a wooden wall, ten feet high and 
fifteen feet long. As the candidates stood before it, they were told to imagine 
themselves at the foot of a barrier that extended, like the wall of China, 
for thousands of miles. For this reason it would be impossible for them to 
go around it (nor would they be permitted to look around it), Actually, 
they were facing two pariillcl walls of equal height and width, eight feet 
apart, only the first of which, however, could be seen by them. In front 
of them was a heavy log, and near by on the ground were an old board 
a few inches longer than the log, and a couple of two-by-fours, one two 
feet and the other three feet in length. 

The men were informed (fancy being mixed with fact as in other situa- 
tional tests) that although they could not see it, the barrier before them 
actually consisted of two walls (fact) separated by a two-hundred-foot 
canyon (fancy). They were escaping from some Japanese soldiers, and in 
order to save themselves they would have to get to the other side of the 
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far wall, and to fulfill their mission they would have to take their king- 
size bazooka (the log) with them. They might get across the wall in any 
way they wished, but they must not walk around the ends of the wall, and, 
of course, whoever or whatever fell into the canyon would be counted lost. 
With no time allowed for preparation of a plan of action, they were told 
at once that they were being timed. 

The solution of this problem proceeded somewhat as follows. Two men 
would climb to the top of the first wall, pushed up by their companions or 
by using the short two-by-fours braced against the wall. Having reached the 
top, they would see that the problem was to build a bridge between the 
two walls and that the log might be used for this purpose — if it were long 
enough. Sooner or later someone would see that the long, light board could 
be used to measure both the length of the log and the distance between 
the two walls. By comparing measurements they would discover that the 
log was long enough to reach from one wall to the other. But how to get 
it across? Soon someone would see that if the board were supported on the 
far wall and held by someone on the near wall, the log could be pushed 
across it. Once the log was in place the men would straddle it and work 
themselves across to the other side, and, then, using the board again as a 
support, they would pull the log over to them, drop it to the ground and 
finally jump down themselves. On rare occasions a candidate would stand 
on the narrow shelf on top of the first wall and jump to the second. Then, 
by reaching out to support the log as it was pushed toward him, he would 
succeed in getting it onto the second wall without the aid of the board. 
Although the men would sometimes stand the log up on one wall and 
drop it down neatly onto the top of the other wall, such attempts to solve 
the problem without using the board were seldom successful. 

The same variables that were rated at the Brook were also rated at the 
Wall, and since the two situations were so similar and since they followed 
so immediately upon each other, it was our practice to treat them as a 
unit, the final rating of each variable being based upon a man’s performance 
in the two situations. The Wall served to amplify our recently gained 
impression of how the candidates would handle a physical problem. We were 
anxious to know what changes a fresh start in a new but similar problem 
would reveal in the behavior of individual members and in the structure 
of die group. 

Since the Wall, like the Brook, was a leaderless situation, it was interest- 
ing to see whether the same man would take charge of both undertakings, 
or whether a new man would seize the opportunity offered by the change 
to exert authority. Frequently the same man directed both tasks, but often, 
too, a new man would take over, particularly if the leader at the Brook 
had been old and heavy-set and thus unable to get quickly to the vantage 



Assessment at S; Procedures 


101 


point on top of the wall. The original leader in this situation was often 
the man who got to the top of the wall first. If this was his only qualifica- 
tion, he soon lost his authority when others got up beside him, but a man 
with some aptitude for leadership could gain a decided advantage simply 
by getting to the top first. The good leader would see that too many men 
did not crowd the top of the wall while the log was being passed up, he 
would have the stronger men remain below to pass up the log but yet 
avoid the predicament of having the last man a heavy, awkward person who 
could not reach the top without help from below* Similarly, he would direct 
traffic across the log to the other side, sending a lithe, confident man first to 
help the more timid and awkward ones who would come in the middle 
while he or some other brought up the rear. The man with good physical 
ability would be quick and agile in climbing the wall; he would show 
strength in handling the I(jg, and be without fear or awkwardness in crossing 
it. In physical ability, the man who jumped from one wall to the other with- 
out falling (fortunately none who attempted this feat ever failed) was 
clearly very superior. 

The occurrence of these two outdoor situations on the first morning 
usually served to engender a state of high morale among the candidates. 
The contrast between a group before and after the Brook and the Wall 
was striking. On the way down convcr.sation was usually scanty and 
somewhat strained; on the way back it was characteristically lively and gcxid- 
humored. The awkwardness that had led to slips .such as dropping the rock 
or a teammate into the brook was recalled with laughter, and those who 
had been responsible had to tolerate the ribbing of their teammates. Com- 
ments and compliments about the special feats of certain men made for 
good feeling, and discussions, encouraged by the staff, of how the group 
would go about these tasks were they to do them again provided an oppor- 
tunity for making new suggestions or criticizing those of others. Such talk 
revealed something more of the practical intelligence as well as the social 
relations of the candidates, Frequently a group in which esprit dc corps 
was beginning to develop would start planning how they would coordinate 
their efforts if and when they worked again as a group. In general the 
amount of interest shown in discussing .situations and in [ilanning for future 
ones varied with the degree of previous success. Groups which had failed 
to solve the Brook problem in the allotted hour had few ideas as to how 
they would do it again and little zest for similar undertakings in the future. 
But they, like others, though perhaps for different reasons, wanted to know 
how other groups had solved the problem; and if there were some who 
had shown their resentment in any way, these were data to be observed, 
remembered, and interpreted, if possible, in the light of other information 
that would be subsequently obtained about these candidates, 
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Construction.— Sometime during the morning of the first day each 
candidate had an appointment behind the barn. If hearing of the location 
of this appointment made the men recall, sometimes with amusement, events 
in their boyhood when they had kept similar appointments with their 
fathers, it is safe to assume that even such recollections failed to prepare 
them for what they would experience on this occasion. 

Ostensibly this was a test of the candidate’s ability to direct two helpers 
in building with him a frame structure out of simple wooden materials, 
Actually the situation was not so benign as it first appeared. To be sure, it 
was a test of Leadership, but more truly it was a test of Emotional Stability 
and frustration tolerance, Energy and Initiative in carrying out the work 
and the Social Relations of the candidate in relation to his helpers were 
also rated. 

The building materials for this test were wooden poles of two lengths 
(5 and 7 feet), wooden blocks with sockets into which the poles could be 
fitted, and small pegs to hold the poles and blocks together. The blocks 
were of two sorts, full blocks and half blocks. The full blocks were of 
octagonal shape with sockets cut into each of the eight sides. Running 
through the center of each block was a circular hole of the same diameter as 
that of the poles. The half blocks had sockets in only three sides but 
attached to and protruding from the opfX)sitc long side was a dowel the 
thickness of a pole which could be inserted through the center hole of a 
full block. This equipment was a great magnification of the *‘t!nkcr toy” 
sets of childhood. With this, each candidate was directed to build a 
5-foot cube with 7-foot diagonals on the four sides. 

When the candidate came to the area where the test was to be conducted 
the stall member said to him: 

We have a construction problem for you now. We want you to build a struc- 
ture using the equipment lying around here. Let’s see. {The staff member ap^ 
pears to ponder which of two or three models of different design to use.) I 
guess we’ll give you this model to copy. {Staff member picl{s up the model 
which is always used from among the others and shows it to the student.) 
You see there arc short 5-foot and long 7-foot poles lying on the ground. {Staff 
member points out one of each sizef) The sides of the frame which you arc to 
build are made of 5-foot poles, and the diagonals of 7-foot poles. {Staff member 
demonstrates this on the model.) Do you understand? 

Now the corners where the poles come together are made like this, You take a 
half block and put it through a full block. Then you cinch it with a peg, like 
this. {Staff member demonstrates all this.) Tlicn when you put the corner down 
on the ground, you can put 5-foot poles in here, here, and here, and the 7-foot 
diagonals here and here. Do you understand? ' 

Now {staff member pic\s up the corner and points to the peg) you will 
notice there arc holes for pegs like this at each socket, and similar holes in the 
en 0 each pole. Be sure, whenever you put a pole into a socket, to cinch it 
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with a peg, because unless that is done all over the structure it will not be stable. 
(Staff member then throws the sample corner to the ground,) Is this all clear? 

This is a construction problem, but even more important than that, it is a test 
of leadership, I say that because it is impossible for one man working alone 
to complete this task in the ten minutes allotted to do it. Therefore we are going 
to give you two helpers who work here on the estate. You arc to be the super- 
visor, their boss. You arc to guide them in their work, but as foreman, you will 
follow more or less of a handjj-ofl policy. Let them do the manual labor. You 
can assume that they have never done such work before and know nothing about 
it. Any questions? (Final pause to amplijy any details not understood by the 
candidate,) 

All right. It is now ten o’clock. You have just ten minutes in which to 
do the job. I’ll call your two helpers, 

At this the two assistants, who had been working in the barn, were asked 
to come out and help the candidate. They complied, but waited for him to 
take the initiative. Tliese two members of the junior staff traditionally 
assumed the pseudonyms of Kippy and Buster. Whoever played the part 
of Kippy acted in a passive, sluggish manner. He did nothing at all unless 
specifically ordered to, but stood around, often getting in the way, cither 
idling with his hands in his pockets or concerned with some insignificant 
project of his own, such ns a minute examination of the small-scale model, 
Buster, on the other hand, [)laycd a different role. He was aggressive, for- 
ward in offering impractical suggestions, ready to express dissatisfaction, 
and quick to criticize what lie suspected were the candidate’s weakest 
points, 

The two assistants were not permitted, by their secret instructions, to 
disobey orders, and they were suppo.scd to carry out whatever directions were 
given to them explicitly. Within the bounds of this ruling, though, it was 
their function to present the candidate with as many obstructions and 
annoyances as possible in ten minutes. As it turned out, they succeeded in 
frustrating the candidates so thoroughly that the construction was never, 
in the history of S, completed in the allotted time. 

At first the assistants appeared cooperative, but if the candidate did not 
introduce himself and ask their names, Buster would observe that a boss 
interested in getting along with his men would at least find out their names. 
If the candidate did not explain in detail what they were to do, referring 
to the model, Buster would complain that they were receiving inadequate 
directions and remark that the candidate must be inexperienced. If he were 
either peremptory or passive, he would be criticized for this. Buster might 
say that that was a poor trail in a leader, and add that he found it hard 
to understand h'ow anyone could ever have thought the candidate was worthy 
of holding an important position in the organization. If the candidate became 
so incensed at their unmanageableness that he laid a hand on them with 
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the intention of getting them to work fnitcr, the liclpcr wlui was" ttnichcd 
would take great offense. After the work had begun, Buster, (ir occasionally 
Kippy, might criticize the candidate’s plan of operation and suggest other, 
often incorrect, ways to proceed in order to test the idiccfulncss of the 
man’s leadership. Kippy, for instance, might attempt to involve tlic boss 
in a debate about the relative advantages of the two [)lans. Or he iniglu 
get into an argument with the other assistant over alternative methods of 
building a corner. Again, he might say that the octagonal edges of the 
corner blocks were the “rolling edges,” and that tlicy woiikl not rest firmly 
enough on the ground to hold the structure. (Actually they wcjuld and 
that was the correct way to build the cube,) The assistants might try to 
get the leader to lay the blocks down flat, which was incorrect. '1‘licy might 
even point to four holes in the ground, suggesting that those must Ije the 
places where previous workers had laid the ccirncrs Hat. Ur, in another 
attempt to divert the candidate from his plan, they might prdnt out w him 
that the model was mounted on cardboard, and stiggcst that he search 
the area for cardboard with which to make a l)asc for the .structure so that 
it would be exactly like the model. If the candidate accetlcd to their sug- 
gestion, he wasted time, because he was not directed tt^ build such a base. 

Frequently the candidate began to construct the cube incorrectly. When 
this happened the assistants would follow his (orders for a white and then 
point out the errors, at the same time tearing down the structure if the 
leader did not stop them. From time to time, if Buster discovered a pole 
that was not pegged into its socket, he would kick the two [)ieccs apart, 
saying sharply that no sensible person would expect such a framework 
to hold together unless it was pegged. It wa.s discouraging t(,» any man to 
see his cube collapsing before his eyes, but tlie reactions differed. Some 
candidates became bitter; others gave up and refused to ccmiiiuic. On the 
other hand, good leaders would patiently begin again cjr direct the helpers 
to stop tearing the pieces apart until they had decided whether the mistakes 
could be more easily rectified. 

Another stratagem used by the two assistants wlicn the work was well 
under way was to distract the candidate’s attention frtim the job, ‘"Htcy 
asked questions about him—whcrc he came from, what his real name was, 
how long he had been in the Army, where he gta his accemt, ami so on, 
They made an effort to break through his cover story if lu: ans^^«crcd these 
questions, and often their attempts were successful. If lie refused to reply 
to their queries because of concentration on the jtjb, they accused him of 
being unsociable. If they noticed anything particularly distinctive about 
him—for example, ^ a^ peculiar accent, baldness, a reserved attiuidc—thcy 
burlesqued this trait in order to irritate him further. If he mentioned any 
special interest, they encouraged him to discuss it. If he became distracted, 
they continued on that line for a while, and then Buster might suddenly 
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tell the candidate he was neglecting the job. He might accuse him of being 
“the poorest leader I ever saw around here/* and suggest, since he was so 
obviously inept, that he give up the assignment entirely. If, after a few 
minutes of such frustrations, the candidate stopped directing the others 
and began to do the work by himself, or showed any evidence of emotion, 
Buster would immediately note this reaction and make some caustic com- 
ment designed to heighten it. 

While Buster was needling the candidate in this way, Kippy was moping 
about, doing little. If he was given a direction, he complied slowly and 
clumsily, showing no initiative, stopping as soon as he had completed the 
specific task. He sometimes went up to the candidate to request permis- 
sion to leave for a minute “to go get a drink,” In general he followed the 
policy of passive resistance, doing everything possible to sabotage the con- 
struction by his inertia. 

To illustrate how the helpers turned the conversation in Construction 
into banter which could be exploited for purposes of personality assess- 
ment, a typical protocol is reproduced here. 

Stapf member {calling toward the barti) \ Can you come out here and help this 
man for a few minutes? 

Buster and Kippy: Sure, we’ll he right out. 

Stapp member: O.K,, Slim, tliesc arc your men. They will be your helpers. You 
have ten minutes. 

Slim: Do you men know anything about building this thing? 

Buster: Well, I dun no, Tve seen people working here. What is it you want done? 

Slim: Well, we have got to build a cube like this and we only have a short time 
in which to do it, so I’ll ask you men to pay attention to what I have to say. Til 
tell you what to do and you will do it. O.K.? 

Buster: Sure, sure, anything you say. Boss. 

Slim: Fine. Now we are going to build a cube like this with 5-Coot poles for the 
uprights and 7-foot poles for the diagonals, and use the blocks for the corners. 
So first wc must build the corners by putting a lialf block and a whole block 
together like this and cinching them with a peg. Do you see how it is done? 

Buster: Sure, sure. 

Slim: Well, let’s get going. 

Buster: Well, what is It you want done, exactly? What do I do first? 

Slim: Well, first put some corners together — let’s see, wc need four on the bottom 
and four topside — yes, we need eight corners. You make eight of these corners • 
and be sure that you pin them like this one. 

Buster: You mean we both make eight corners or just one of us? 

Slim: You each make four of them. 
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Buster: Well, if we do that, we will have more than eight Iwcause you ahead' 
have one made there. Do you want eight altogether or nine altogether? 

Slim: Well, it doesn’t matter. You each make four of these, and hurry. 
Buster: O.K., O.K. 

Kippy: What cha in, the Navy? You look like one of them curly-hcadcd Navv 
boys all the girls are after. What cha in, the Navy? ^ 

Slim: Er no. I am not in the Navy. I’m not in aiiytliing. 

Kippy: Well, you were just talking about “topside” so I thought maylx: you 
were m the Navy. What’s the matter with you-you look healthy cnouch Arc 
you a draft dodger? b ■ 

Slim: No, I was deferred for essential work— but that makes no difference. Let's 

die poles with 

Kippy.' -nie more I think of it, the more I think you arc in the Army. You run 
this job Nst like the Army-you know, the right way, the wrong way, and the 
Army way. Ill bet you are sonic second lieutenant from Fort licnnlng! 

Slim: That has nothing to do with this job. Let’s have less talk and more work, 
Kippy: Well, I just thought we could talk while we work-.-it’s more pleasant. 

ti* aT-tpor 

Buster; Don’t you think we ought to clear a place where we can work? 

Slim: That’s a good idea. Sure, go ahead, 

Sng TbS Wz °iWe “"y 

Duiioing, I bet. Jeez, I ve seen a lot of guys, but no one as dumb as you. 

M. Well, that may be, but you don’t seem to be doing much to help me 

around here! ' ''' helpful as anyone could be 

Yo™n™« f ""/''''"e 

anyway. No one else ever comni ' °k know what you are doing 

apolog! for Whatt 2d ab'STe ^ - 

dm.. Y» qu’amTVL™, 

Buster: Who you talking to-him or me? 

Kippy: That’s right-how do you expect us to know which 


one you mean? Why 
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don't you give us a number or something — call one of us “number one” and the 
other “number two”? 

Slim; O.K. You are "one” and he is “two.” 

Buster: Now, wait a minute — ^just a minute. How do you expect to get along 
with people if you treat them like that? First we come out here and you don't 
ask us our names — you call us “you.” Then we cell you about it, you give us 
numbers. How would you like that? How would you like to be called a 
number? You treat us just like another 5-foot pole and then you expect us to 
break our necks working for you. I can see you never worked much with people. 

Slim: Fm sorry, but we do not have much time and I thought — 

Kippy: Yes, you thought. Jeez, it doesn’t seern to me cliat you ever did much 
thinking about anything. First you don’t ask our names as any stupid guy would 
who was courteous. Then you don’t know what you did before you came here 
or whether you are in the Army, Navy, or not, and it’s darn sure you don’t 
know anything about building diis thing or directing workers, Gripes, man, 
you stand around here like a ninny arguing when we should be working. What 
the hell is the matter with you, anyway? 

Slim: I’m sorry — what arc your names? 

Buster: I’m Buster. 

Kippy: Mine’s Kippy, What is yours? 

Slim: You can call me Slim. 

Buster: Well, is tliat your name or isn’t it? 

Slim: Yes, that is my name. 

Kippy: It’s not a very good name — Dumbhead would be better. 

Buster: Where do you come from, Slim? 

Slim: Cincinnati. 

Buster: That’s out in Ohio, isn’t it? 

Slim: Yes. , 

Buster; What’s the river it’s on? 

Slim: Uh— why the Ohio, 

Buster: You don’t sound very sure, I almost wonder if you do come from there. 
I’d think any Cincinnatian would remember the name of the river. 

Slim: I’m from Cincinnati, all right. I lived there for eight years. 

Buster: Down by the river? In the tenement district? 

Slim: No, in a residential region up to the north, 

Buster: What street? 

Slim: Why, 1490 Kingsbury Street. What does that have to do with the present 
problem? 
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Buster: The reason I asked was you don’t seem to be very well dressed, and I 
thought probably you hadn’t made much of a success of your business and 
couldn’t live in a nice part of town. 

Sum: Be that as it may— we’ve got to get back to work. You aren’t doing any- 
thing except talking and the time is passing rapidly. ^ 

Buster: Well, what kind of a boss are you anyway? You haven’t told me any- 
thing to do. You stand there and say “get to work, get to work,” but you don’t 
say what I should do. Another thing, Kippy’s just sitting over there trying 
to make that pole stick into the dirt and you don’t make him work. You might 
at least treat us both the same. Why don’t you act like a boss? Why don’t you 

say, Come here, Kippy, you good-for-nothing, and justify your existence. Get 
some work done!” 


Slim:^ Come on over. Kippy; he’s right. We all have to work together You 
haven t been doing your part. Don’t you want to help? 

Kippy: Sure I do, but you haven’t told me anything to do. 

Slim: I certainly did. I said to make some corners and you just went over tliere 
and sat down. 


Kippy: If that’s the way you’re going to talk to me-yelling and hollering and 
losing your temper-just because you can’t give orders a fellow can understand, 
i don t have to work for you. You’ve got to be decent. 

corners for the bottom of this using a whole block and a half block pegged to- 
gether with a peg like this. ‘ 

Kippy: Well, why didn’t you say so long ago? You sure wasted a lot of time. 
Buster: We’ve got to work faster. 

Slim: That’s rights Buster. 

Buster; I suppose you know you’re not very observant. 

Slim: What do you mean? 

ITrl ^ ^ ^ u to your mind? Could it be the place to lay 

ind° down on the ground to make them firm? You have your corners 
standing up on the rolling edges and that isn’t very stable. 

Slim: It looks all right to me, if the four poles were put into the corners. 

Buster: O.K., if you want to sacrlHce stability for mobility, it’s up to you But 

he boss, you say. I m better than those other guys. If I’m in charge T’m n 
going to listen to them. Even if they are rieht I won V ^ v charge I m n 
going to show them who’s in control around here” ^ 


m 

not 

m 


Slim: Well, wc’ll try your way, but I don’t think ’it’s necessary. 

Buster: Slim isn’t your real nickname, is it? It couldn’t be with that shining 
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head oE yours. What do they call you, Baldy or Curly? Did you ever think ot 
wearing a toupee? It would keep you from getting your scalp sunburned. 

Sum: I don’t see “what difTerence that makesl Come on, both of you, and pul 
an upright in each Corner. 

Kippy: He’s sensitive about being bald. 

Busteh; Yeah. , . . Well, Captain, vve don’t seem to be getting much done here, 
do we? 

Slim: Well, if you guys would get to work we would. 

Buster: Well, it seems to me it’s sorta late now. Why don’t you be a man and 
admit that you can’t do this job? After all, it’s only a toy and sort of foolish for 
a grown man. It’s nothing to be ashamed of that you can’t build it. It’s just 
not in your line. 

Slim: Well, I’d like to do as much of this i\s possible, Will you help me? 

Buster: Sure, sure, we’ll help you, but it doesn’t seem to be much use. What do 
you want us to do now? 

Slim; Well, one of you build a square over there just like this one while the 
other one puts in the uprights and diagonals on this one. 

Kippy: May I ask a question? 

Slim: Sure, go ahead. 

Kippy; Why build one over there? What arc you going to do wiili it dicn? 
Slim; Well, we’ll put it on top — the top of this cube is like the bottom. 

Kippy: Well, if that isn’t the most stupid thing I ever heard of. Since when 
do you build the roof of a house and lift it to the top? Why not build it right 
on the top? Listen, when you build a house you build the foundation, then 
the walls, and then the roof. Isn’t that right? 

Slim; Well, that is usually the way it’s done, but I think we can do this job this 
way. In fact, I don’t think it matters much which way wc do it. Either way 
is O.K., I guess. 

Buster: You guess, you guess. What kind of a man are you anyway? Why in 
hell don’t you make up your mind and stick to it? Be decisive— didn’t they tell 
you that in CCS? — be decisive— -even if you arc wrong, be decisive, give an 
order. What are you — man or mouse? 

Kippy; Oh, it’s no use talking, Buster, vvlicn he doesn’t have a bar on his 
shoulder he doesn’t know what to do. Listen, Mac, you’re not on Company 
Street now. You haven’t a sergeant to do your work for you. You’re all alone and 
you look pretty silly. Why, you can’t even put together a child’s toy. 

Slim: Now listen to me, you guys, arc you going to work for me or aren’t you? 

Buster; Sure, we want to work for you. We really don’t care. We’d as soon work 
for you as for anyone else. We get paid all the same. The trouble is we can't 
find out what you want done. What exactly do you want? 



110 Assessment of Men 

Slim: Just let s get this thing finished. We haven’t much more time. Hev therr 
you, be careful, you knocked that pole out deliberately* ^ 

Kippy: ^o, me? Now listen to me. you good-for-nothing young squirt If thU 
darned thing had been built right from die beginning the poles wouldn’t come 
out. Weren t you told that you had to pin these things? Why, none of it is 
pinned; look at that, and that, and thatl (Kicl^s the poles which were not pinned 
out of position and part of the structure collapses.) ^ ^ 

Slim: Hey— you don’t have to knock it all downi 

Buster: Well, it wasn’t built right. What good was it without pins? 

Sum: I told you guys to pin it. 

Kmpv: I pinned every one you told me about, How did I know you wanted the 
others pinned? Jeez, they send a boy out here to do a man’s job and when he 
can do It he starts blammg his helpers. Who is responsible for thl.s-you or me? 
Cnpes, they must really be scraping the bottom of the barrel now. 

Stafp membm {Walking in from the sidelines)- All right, Slim U nil 

the time we have. The men will take this down. 

-nyo™ 

is the most desirable behavior for a candidate 

attempted Sme ^“t^inly di.sparatc .sort.s of .soliition.s were 

h nd?^ Jme candidates, after they had seen tliat they were being 

assistants, either neglected them of 

anger. " candidate struck an assistant with his fi,st out of 

fepii hT. f r„ 1, * 

ing. At the same time he b them, and keeping them work- 

U^elperiike elratwel^r’’'™ 

t» them, and taking thei, ctiti.L/ugESy T Wli ‘‘“‘”7 

to them with responses calculated nJT a V‘ ^ 

sensibilities. It was, of course hard f end overmuch their delicate 

he could get more done in the ^ candidate to decide whether 

g more done in the ten-mmute period by acting entirely alone 
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or by relying on the dubious cooperation of the helpers. At any rate, the 
problem was never camplctcd in the allotted time, and usually it was scarcely 
begun. 

Just what was measured in this situation is difficult to state exactly. 
One criticism leveled at it has been that many of the candidates looked 
on it merely as an artificial test instead of as a real-life problem, and so 
it was not indicative of anything significant. This criticism applies to 
every situational test. But the truth is that, while some candidates after- 
ward said they did not take the problem seriously because they knew 
it was a test, a larger number admitted that they forgot themselves in it as 
they would in a real situation. The cases where the candidates lost their 
tempers, hit their assistants, or showed other marked evidences of emotion 
bear this out. 

Starting for the candidate as an opportunity to demonstrate leadership, 
Construction would gradually become for him a test of his capacity to work 
toward completion of the task in the face of increasing pressures furnished 
by the stooges. His helpers were cooperative at the beginning but each candi- 
date inevitably did or said something which furnished an excuse for 
criticism, vilification, and active interference. The stooges made a strong 
effort to incite anger, impulsiveness, and the suspension of the normal 
controls of behavior. Except for attacking the candidate physically, practically 
every other technique for making him feel foolish and miserable was em- 
ployed. The presence and behavior of these helpers represented the provoking 
stress in the situation. 

Another force in the environment operating upon the candidate was the 
presence of the staff members observing on the side lines. Their presence 
had the effect of impressing upon the candidate the need for controlled 
and sensible action. He was partly aware that he was on the spot and 
that any untoward behavior on his part would be counted against him, 
There is some basis for arguing that if the staff observers had not been there 
his behavior might have been more unstable, or at least less restrained 
and hence easier to assess. On the other hand, the presence of the staff 
was an additional strain which tended to magnify conflicts and tensions 
within the recruit, Undoubtedly this Construction test represented a unique 
kind of stress which in intensity would probably never be matched by 
many field situations. Certainly it did evoke emotion and was a constant 
challenge to the student to keep himself under control and to continue 
at the task. And it was more than a "snafu** tolerance test, for it alforded 
insight into the candidate's range of affective behavior as well as the 
security measures which he took against anxiety, For various candidates 
it had different degrees of artificiality, some guessing immediately that the 
"helpers’* were really staff members bent on upsetting their control, while 
others, having accepted the test as a real situation, remained naive to the 
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very end. Even though an occasional candidate had quick insight about 
what was going on, the situation was generally stressful Obviously the 
degree of insight possessed by a candidate was always taken into account 
in interpreting his observed behaviorj even though our best measure of his 
insight was not obtained until the Post-Construction Interview was held. 

Emotional responses revealed at Construction seemed to provide a good 
gauge of tolerance for frustration and “snafu,” particularly in the field of 
interpersonal relationships. At times it exceeded a candidate’s limit. There 
were men so shaken by their experience behind the barn that they begged 
to be released from the assessment program and from OSS, if work in the 
organization required that one remain calm and in control of hinisself 
in such circumstances. 

This situation was also a test of leadership, at least of a sort. How good 
a leader a man was was gauged by the way he dominated the situation; 
how he outlined the task to his subordinates and explained why they should 
follow the course he set; how he took suggestions from subordinates; 
how much consideration he showed them; how pleasant his relationships 
with them were despite their criticisms; and how much respect anti work he 
could elicit from them. Leadership was hard to measure because the golden 
mean between authoritarianism and laxness was scarcely achievable in this 
situation. 

It is obvious that a man’s ability to maintain agreeable social relationships 
could be well tested in such a difficult situation, and it was usually found 
that this trait was easier to evaluate satisfactorily than cither Emotional 
Stability or Leadership. It was also possible to rate the candidate’s interest 
in the problem and his zest and energy in attempting to get it done. 

To provide candidates with an opportunity for emotional catharsis 
after this situational test, as well as to employ another technique for assess- 
ing them, a Post-Construction Interview was introduced into the program. 

Post-Construction Interview. — After a candidate was told that his time 
was up in Construction, die staff member who had given him ilie instruc- 
tions accompanied him as he walked away from the scene. Establishing 
a friendly rapport with the candidate, the staff man asked what he had 
thought of the whole thing. There wore those who very early had sensed 
that the helpers were only stooges; they had perceived the situation as a 
test and were able to refrain from emotional involvement throughout die 
situation regardless of the pressure which the stooges applied. On the 
other hand, there were those who never gained any insight into the situa- 
tion, who at the end were still complaining about the caliber of our hired 
help, and who solicitously inquired if we could not find better workmen, 
Sometimes a man who had kept an unruffled exterior during the situation 
admitted in the interview that he had been extremely disturbed or had only 
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with great ellon rclraincd frcun luttJng his assistants, yiiiie clidcrcni were 
those who, with quivering u[)pcr lips and treml)ling hands, nevertheless 
insisted that they had not been the least upset by the insults and lack of 
.cooperation of their helpers, I’his interview prtjvided candidates with an 
opportunity to evaluate their performance and to indicate how diey wniihl 
seek to handle the helpers if they were to find themselves in this situati(ni 
again. It gave them a chance to speak modestly or boastfully about their 
past experiences in charge of men, and thus, if they were not on tlieir guard, 
they might be tricked into breaking cover, for X conditions were n(;t estab- 
lished at this time. 

In keeping with the philosophy of a.sscs.smcnt, the Post-Construction 
Interview was intended to be therapeutic, to help die candidate adjust to 
his unpleasant experiences as quickly as possible. It was also immensely 
valuable in revealing how the student viewed the situation, how much in- 
sight he had, into himself and others, how objectively he viewed himself, 
and how he rationalized his performance. Here, too, it was pfj.ssible to make 
some estimate of how quickly the man could recover from disturbing 
experiences. 

After the termination of the Post-Construction Interview, the stall member 
returned to his colleagues, to whom he reported brielly die gist of what the: 
candidate had said, and the new meaning which, as he saw it, the eandidale's 
remarks gave to his performance in Con.struction. Here, as in all procedures 
at S, the aim was to evaluate every bit of behavior in the context of all the 
information that could be gathered about a caiitliclate. Neither Construc- 
tion nor the Post-Construction Interview was construed as giving inde- 
pendent measures of Emotional Stability or of any other trait. Instead, they 
were thought of as rather unusual conditions created to elicit fragments of 
behavior which, when considered in relation to fragments of behavior evoked 
in other situations, might yield a [ucturc of the personalities of the candidates. 

The Interview.— Immediately after the instruciicnis for the Terrain Test 
had been given, some students went to the third floor for their Personal 
History Interviews under X conditions. Others were seen for this purpose 
later in the morning, and still others were intcrviewctl that afternoon or 
the next day. Usually all first interviews with candidates were completed 
by noon of the second day, leaving that afternoon and the following day 
for any follow-up interviews which might be required in difficult cases. 
These interviews were, without doubt, the incest important single procedure 
in the program at S, though they were not its most original feature. 

No procedure yet devised by psychologists for the study of the person can 
take the place of the clinical interview. At S it contributed more heavily 
than any other procedure to the final rating of all personality variables. It 
provided the frame of reference in which all other observations were 
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evaluated. From it came a large measure of the understanding of the person 
which made it possible either to recommend him or not to recommend him 
for his proposed assignment. 

Though at S projective techniques and situations were u.scd to find out 
some of the things about a man that he could not or would not tell, this 
did not diminish the importance of what a man could and would tell 
freely. Nor was there any reason why we should have sought a substitute 
for the Interview, for there was certainly no technique that yielded more 
that was relevant and significant than the hour and a half spent in listening 
to a candidate talk about himself. ^ ^ 

The contributions of other procedures to the Interview have already 
been indicated. Chiefly they provided data descriptive of the personality at 
any instant of time; that is, data which were more or less static. It is 
obvious that the conclusions drawn from the candidate’s performance in the 
test situations did not necessarily oficr reliable evidence for predicting the 
future. It was, of course, important to know how lie reacted in a stninge 
environment and under the simulated field conditions which obtained at the 
assessment school. But in die last analysis, the tc,st performance was a 
response to a peculiar, possibly even a unique, sec of circiimstancc.s. The 
number of such situations which could be employed even in a ihrec-dav 
test period was comparatively small, and could never approacli tlie great 
variety of reality problems met in everyday life. Further, it was neccLry 
to know whether these reactions were indeed typical of his responses 
0 various life situations, whether they fitted into his general behavior pat- 
tern, or whether they were atypical and had not previously been manifested. 

by serm Tth importance which could best be estimated 

k ^ adaptability. Had the 

rigid ‘^anxiou“ responsibilities, or had^ie become 

ngid, anxious, and insecure when faced with the necessity of acting on 

0 bv 7 by competent authority 

sLiLanffT' ° '^besc and many othcl 

alone^ ^ observation of the test situations 
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k He knew how the candidate had reacted on entcrine 
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material produced in r. drawn from the amount and type of 

P C d m response to the various questions. Were these remarks 
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stereotyped? Were they superficial? Or did they reveal a richness of emo- 
tional life and a degree of understanding of self and others which might 
prove invaluable in certain missions? The interviewer knew the job for 
which the man was a candidate, and the special personality attributes con- 
sidered important for achieving success in that position. There would also 
be made available to him any significant items which might have been un- 
covered by the Security Branch in its investigation of the candidate’s record. 
All these observations, as well as those made in the Interview, were 
utilized for further investigation of the candidate’s reactions, and for the 
integration of the final picture of his personality. 

What did we obtain from the Interview? We learned, of course, what 
the candidate said about himself, his past, his wishes and fears, his hopes 
and aspirations. An important distinction was made between what he said 
that was factual, and what he said that belonged to the realm of fantasy, 
opinion, and sentiment. 

The factual material was that which could be checked by independent 
observation or investigation. The subject told us at what school he had been 
educated, when he obtained his first job, what the members of his family 
were doing, how much he earned, and so on. Facts of this order could be 
obtained from other sources, but it was convenient to ask the subject directly 
for them, and since in most instances the subject had no reason to conceal 
the truth and little reason to be biased, what he said could be taken at its 
face value, that is, as a statement of what actually happened or was happen- 
ing. Much indispensable material of this kind was obtained in the Inter- 
view. 

Most of the interview material, however, was made up of the subject’s in- 
terpretations of and reactions to what had happened in his past, and to his 
situation of the moment — avowals of opinions, sentiments, attitudes, wishes. 
Statements of this kind were not to be regarded from the point of view of 
their truth or falsity; they were simply expressions of how the subject 
thought or felt, and when they were considered in relation to other findings 
they were of the greatest importance for understanding the personality. For 
example, what a subject said about his father may or may not have been 
true in an objective sense, but it was a good indication of his attitudes or 
of what he thought his attitudes ought to be. These statements, when inter- 
preted In the light of the total context in which they appeared, comprised 
the most revealing interview material. When one had explored in this 
fashion the major areas in which one might expect to find the determinants 
of personality — family relations, childhood events, socioeconomic status, na- 
tional or cultural background, school and religious influences— and inter- 
preted the material according to a dynamic theory of personality, he had a 
fairly good conception both of the subject’s actual situation past and present 
and of the dispositions which had been set going in him. 
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Another kind of material was obtained by watching the subject's hcliavicj 
in the interview situation, by noting wliat a candidate was most inclined t( 
talk about, what he spoke of with the most satisfactifin or with the mos 
distress, what were the topics which, when mentioned, caused him the mos 
ernbarrassment or inhibition. In other words, it oficn liappcned that how i 
thing was said seemed just as important as what svas said, and it sva.s onl\ 
in the Interview that this aspect of the candidate's revelations could lu-operK 
be appraised. * ^ 

The technique of the Interview was very ilcxihle. It w.ts felt that any cfTori 
to force the inquiry into previously determined channels would inevi- 
tably result in loss of spontaneity and make for an artificiality of atmosphere 
in which no real understanding of the pcr.son cotihl he attainefi, The Inter- 
view was regarded not only as a source of important hisioric.d data, hut also 
as an exceptionally revealing tost situation. It was not alw.iys what the ran- 
didate produced in the way of factual information wliich was important' in 
studying his reaction patterns; in many instances his behavior durinir the 
Interview constituted the nio.st significant datum. How tliil he handle the 
natural discomfort of being scrutinized and called u[K>n n. explain his life 
record? Was he frank, open, and sure of himself? Was he timonnis. uncer- 
tain, and lacking in self-esteem? Was he friendly or withdrawn? Was he 
surly or did he display a degree of equanimity? Did he manifest an interest 
in learning about himself or was he evasive, rigid, and inclined to rational- 
ize his personality liabilities? 

There sas no attempt to establish a standarrl method for dealing with 
these attitudes. Some interviewers uniformly welcomed the candidate in a 

defining at ease by olTering a cigarette, by 

defining the purpose of the Interview, and by directing tire discussion fir.st 
to some more or less innocuous topic such as the suhject'.s work history, his 

nrh T w^hcli he had first learned about the OSS. 

Others deliberately made the candidate imcomfortahlc by askinir direct ones- 
tions, or commenting upon obvious emotional reactions, of apnrehen. ion, 
resentment, undue levity, and the like. Still other.s adapted themselves m 
each new situation without following a preconceived plan; they were nlcisint 
and delibaratdy permit.,, I arise, .v ti'i;;;, 

course seemed most likely to produce significant material. 

siiblei, aproaches was mo,st productive with some 

£ S r “u""": ■'“'"It ... atatc a rclartan- 

stnec which" meTV"" ' personality type and the most adcqitatc approticli, 
Since which method got results was a function of the interviewe ’s ocr- 

sonahty as much ns of the candidate's. An .attempt to .stir im leaslin was 
made m many instances, particularly in the c.ascs of the overly ohlimm^ 

aS^luld I ' - -as 4 thaf the’ 

could discuss those tensions he actually experienced during the 
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Interview much more ensily thmi he could recall specific emotional conflicts 
when the topic was mentioned in the course of conversation. Needless to say 
this investigation was not carried on in a destructive manner; in fact, not 
infrequently It served a therapeutic purpose. The objective ever in mind was 
that the candidate should leave with a feeling that a sincere effort had been 
made to understand and evaluate his assets, and that the recommendation 
made by the assessment staff would take these into account. 

It is apparent then that, to a degree proportional to the experience and skill 
of the mterviewer, the Interview might be, and indeed was, almost com- 
plete y flexible. In the space of one and a half hours the candidate could be 
closely observed m a variety of interpersonal relationships. One could study 
his behavior when he felt comfortable, friendly, and fully at ease; when he 
was tense and apprehensive; when he was puzzled and uncertain what 
might ha,ppen or what was expected of him. 

As the foregoing remarks imply, the interviewer was free to cover the 
vv ole range of human behavior in his effort to form a trustworthy estimate 
of the candidate’s potentialities. But in practice, there was usually a certain 
uniformity in the material discussed. There arc determinants of behavior 
which are commonly experienced by every individual in the normal course 
of his development, The Personal History Form as finally evolved covered 
these major determinants, and the candidate was called upon to amplify his 
written responses whenever need for amplification was indicated. Con,siclcr- 
ation of the family record, the history of past illnesses, and the scholastic 
achievement contributed to some impression of the candidate’s constitu- 
tional endowment. The description of the parents and siblings, and of the 
family home and interests afforded a picture of the environment which 
shaped his early behavior patterns. The discussion of the neuropathic traits 
of childhood (night terrors, temper tantrums, enuresis, nail biting, and the 
like) showed the extent of early emotional conflicts; further questioning 
would bring out the very important information of how the candidate 
eventually learned to handle the anxiety of which these traits are manifesta- 
tions. A consideration of the school record not only supplied evidence as to 
his effectiveness in using his native talents but also delineated his reaction 
to an increasing range of social opportunities and responsibilities. The in- 
vestigation of his sexual development enlarged upon the picture of his so- 
cial adjustment, and gave further information as to his emotional maturity 
by defining his attitudes toward the most complex and demanding of all 
interpersonal relationships, marriage. It also (gave a picture which might 
possibly serve as an archetype of his reactions to other disturbing problems 
when instinctual drives and group sanctions were in conflict. A considera- 
tion of his record, hobbles, interests, and social activities afforded evidence 
of how effectively and productively he had been able to utilize his talents 
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and training, of his ability to learn from experience, of his stability and 
steadfastness, as well as of numerous other attributes of personality. 

It ^was, of course, in the Interview, too, that the clearest picture of a 
man’s attitude toward his proposed assignment was obtained. His motives 
for overseas duty, and specifically for an assignment in the OSS, were inves- 
tigated both as to their number and strength and as to their soundness and 
durability. The history and present state of the candidate's war morale as 
well as his personal and ideological involvement in the war, were considered 
significant factors in the assessment of his fitness for overseas duty, and it 
was clear that these factors could be nowhere so effectively and so thor- 
oughly studied as in a clinical interview. 

It was not always easy to get a true picture of a candidate in the Interview 
at S. Many of them had good reason to be less than completely frank in 
alkmg about themselves. It was understandable that a candidate might try 
to put his best foot forward, to minimize, if not actually to conceafi thosJ 
personality attributes which might prevent his selection for an assignment 
he very much desired. Further, it must be rememlicred that these eand dat« 
were, for the most part, essentially normal persons. They could point to hm 
pressive records of achievement as evidence of their ability to meet the re- 

f emotional conflicts under such effective control that 

cy lad httle insight into the circumstances which might engender feelings 
of insecurity. Consequently, they were only imperfectly aware of el onali 
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of the man s whole history that allowed one to see the negative trend in the 
personality; though he was a man who could make a good impression in 
many situations, even difficult ones, he had a ‘^weakness’* or “instability** 
which upon occasion came to light. Also there were cases in which the inter- 
viewer gained insight into the subject’s character so that one could interpret 
the high scores he was making in assessment tests as an instance of his 
ability to put up a good front. In such instances, however, by looking again 
and more closely at the subject’s behavior one could usually note that, 
although he continued to earn high ratings by objective standards, there 
were indeed behavorial signs of the underlying defect. In these instances 
the Interview served as a guide for further observation; and the further 
observation came to support the conclusion which was reached in the 
Interview. 

Why, one might ask, if the Interview was sufficiently revealing and de- 
pendable to be given this crucial role, did we not rely entirely on it instead 
of going on with a long and expensive testing program? Of course the 
answer is obvious: we were interested not so much in what a subject had 
done or what he said he could do, as in what he could actually do, and the 
direct way to discover this was to test him. There remains an interesting 
possibility for the future: that one could in time develop interviewing to 
give such high correlations with test and situation performances that ulti- 
mately the former could largely replace the latter. Yet there is a definite, 
though poorly understood, limitation here. Not infrequently in our experi- 
ence a curious discrepancy occurred between the over-all picture of a man, 
obtained from the Interview, and his performance in situations resembling 
those in the field. Of two men who had the same basic personality structure 
—even the same basic unconscious complex— investigation at times showed 
that one was hopelessly inadequate in most life situations, while the other 
had transformed his neurotic drives in such a way that they led to real ac- 
complishment. It was sometimes impossible to tell which was which — one 
had to put them in real situations to see. Then when the behavior was taken 
in conjunction with the Interview a meaningful total picture usually 
emerged. It is the assessment philosophy that it is this total picture, a formu- 
lation of what is relatively central and enduring in the person, that offers 
the soundest basis for prediction. We could best predict behavior when we 
understood as many of its aspects as possible. Without the observations of 
behavior, on the one hand, our predictions would have been highly abstract, 
generalized, and hence Impractical; without the Interview we would have 
been reduced to predicting future behavior wholly from present behavior, 
without thorough knowledge of antecedent determinants; and since the 
same manifest behavior may have different determinants, we should have 
been wide of the mark much more often than we were. 
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The luncheon period on the first day, like all tiieal luutrs, was a time U>t 
staff members and candidates to discuss the tests and sifitaiioiis which had 
recently occurred. Since no places were assi_i;n(,’il at the t.ihles this period was 
an opportunity for staff members to hceotiie aecpiaiiiicd with r.i/ulidat'cs 
other than those whom it was their jirimary rcs|x)n,sihiliiy ttj as.scss, and it 
also provided an opportunity for candidates to jtci irr kiunv men wlio were 
not members of their own subgroups. In a spirit of identific ation with tlicir 
own subgroup and of friendly rivalry with others, candidates asked how 
other teams had fared at the Brook and at the Wall. What method had 
they used? How long had it taken them to transport the log and rock across 
the brook? Had anyone fallen into the w.iter, and if so, 'how h.ul it haiv 
pened? Here was a time to recall their clever .solutions ami their foolii, 
mistakes as if to learn from their errors ami succrss<-,s Imw rlmv should 
tackle such a problem again. It was also a time to l.mgh as ,hey' recdled 
how one group had tied a rope to a high hraneh of tl'ie tire o,,' the near 
side of the brook and had insisted that little Joe hold onto the rope, and 
then, grabbing him by the scat of the pains, they h.id pulled him h.iek aiifl 

Zml r T7u m n'’ ••HKlitinipim. as he approached 

Ae othci bank, Joe had held on and, completing a arc. had l.imlerl hack 

in tlie brush on the near side from which he had st.irted; aiu! how the men 
who had cast Joe off in this manner had paid no more atientioii to him 

and Joe had been left to scramble back through the Inii'sli 'as best he could' 

group, had sent three of his men to a “watery gr.ive," each in exactlv the 

™f“cilrhS7 “ T * "I '“i' '4 

a Cl rock and had had to retrieve them from the near-free /imr w.^er Nor 

The entrance of the stooges into ihr'r f't'n.struction Test, 

enndidm, a chornsVSt ” I "7’ 
covered from the initial shod' ^ca^i Tl* 
behind the barn; and the [i P 

same “impossible” situation an 1* P'l ' "i bad been in the 

P situation, and had probably d„ne no better than they, 
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was sufficient to replace the 11, ,, feelings ol wounJctI vanity wid, a fedinn 

ri™ T'^ ’ "'■'“k. wliik harassing at tlie 

trmc, had ,n retrospect its amusing aspects. Of course, there were those 

who grtped throughout the meal about the test, insisting that it had been “ 
'.III, that the instructions had not been clear, that they had been deceived 
or lha no oiie could be expected to tolerate such insults as had been heaped 
upon them. Others were silent but clearly as resentful, if not more so. Lr 
thoudl^M experience behind the barn was taken in good humor, 

itSev I of candidates with this 4ericnce long 

afto they had left S showed that it had touched most of them deeply and, 
lice several other situations in the assessment program, had taught them 
something about themselves. t' s > i, mem 

Even a casual observer could see that a central part of the whole assess- 
ment program was the fact that everyone lived and ate together, staff mem- 
bers and recruits alike. In such casual contacts the perseveration or nonper- 
sevcration of disturbing emotions could be seen. The ease with which a 
candidate was able to tolcram disquieting feelings and to admit experiences 

0 failure and inadec^uacy without anxiety or resentment revealed something 

01 his basic social and emotional security or lack of it. The sense of humor 
and objectivity with which he could observe himself and his relation to 
others and then make his observations public even when they were not such 
as to inflate or even to support his self-esteem were significant facts to know 
about him. The ease with which a candidate developed rapport with his as- 
sociates, especially when he was the object of their ribbing, or, on the other 
hand, the extent to which he withheld himself from others out of diffidence, 
or opposed them with irritation or even hostility, revealed to the staff facets 
of social relations and emotional stability which, rightly or wrongly, con- 
tributed to our final conceptualization of his personality. 

If the half hour for lunch provided the staff with an opportunity for an 
intuitive grasp of the nature of some candidates, the half hour of recreation 
after lunch was no less rewarding. This was especially true in summer and 
fall, when games of baseball or volley ball with candidates w. staff were 
likely to exhibit not only the degree of team .spirit and good will of a man, 
but also something of his athletic ability. The fact that some men never en- 
tered into such games but preferred to remain alone, whether reading or 
listening to the radio or walking around the estate or taking a short nap in 
their rooms, made the half hour no less profitable so far as the attempt to 
assess them was concerned. The truth is that every minute of the day can be 
rewarding when assessors and subjects live together away from all external 
distractions. Under such conditions the chief restrictions placed upon assess- 
ment are those imposed by the limitations in the energy, initiative, intelli- 
gence, psychological intuition, and insight of the assessors. 
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At 1:30 P.M. this first day of the assessment, after the hour for lunch and 
recreation, all candidates gathered again in the classroom to l>e given a test 
of propaganda skills, a test of observation and memory, and a lest of me- 
chanical comprehension, and to be assigned the task of preparing in their 
free time during this and the next day some materials which would be 
used as another test of their abilities as propagandists. 

OWI Test — This was administered to discover how ‘'culture-sensitive” 
the candidate was,^ how aware of the many elements in a society different 
from his own which ought to be considered in devising propaganda for 
such a people. The assumption was that if a candidate was not sensitive to 
cultural differences, he would have little success as a propagandist no matter 
how great his writing skill, his proficiency in the graiihic art,s, or his admin- 
istrative ability. 

Administered to the group as a whole, the test lasted twenty minutes. 
Each candidate was given a single sheet of paper at the top of which was 
typed the following hypothetical assignment and ciuestion: 

Suppose you have been placed in charge of propaganda activities for OWI 
m Korea, to work out a program designed to win the Koreans over to our side. 
what wformatwn would you want to have? (Assume that you know nothing 
about the country. Omit_ administrative questions of ^taff, finances, and OWI 
policy. Use outline form if you prefer.) 


No further instructions were given other than that they would have twenty 
mmutes and that both sides of the paper could be used. 

The results were scored with the aid of the chart reproduced on page 123. 
ally mark was made for each candidate in the rectangle opposite the 
p rase which best descri^oed each of his requests for information. From these 

Tf tSliror^^ r"" ^^ply the mtal number 

f or, in other words, the total number of requests for information. 

The second, and more significant, score was ihc total of the weights of all 
the categories mentioned by a candidate. Different weights had been rather 

Sn'aiN?,*-" cliffcrcntiatecl 0,1 the basis 

with wS to the frequencies 

th which Items in the various categories were mentioned. The categories 

which were mentioned more often by candidates receiving high scores on 
he test were given higher values. A wdght of 3 was assigned m each of tSe 

a weSoT f nine through seventeen, and 

a weight of I to categories eighteen through twenty-seven 

In the course of time, distribution curves for each of the raw scores based 

thVti?r“'" basis oT hese eur^^e^' 

fud Z W ^ the standard six-point scale 

d combined into a single final rating, which was raised or lowered slightly 



CHART FOR SCORING OWI TEST 


Class S’ — — 
O.W.L Test 


I, Atcicudes toward Korea 


2., No. of radio secs 


3. Literacy 


4. Racial groups 


5. Internal conflicts 


6. Communicacions (words) 


7. Changes with time 


8 . Other dynamic ideas 


g. Economics 


10. History of Korea 


II. Leadership 


11. Social classei 


13. Religion 



14. Taboos 


15. Language» dialects 
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pS?s,x„t' “;;;r' “ 

was great or slight. ' ' «r other conditions) 

7= >-c 

>F 10 «P«at thamclm i,, ,|t '’"f 

obvious that such repetitions were not -.drhV T-T 

not be given extra credit. Second the aim nf T' ' 

to a«ess the breadth and sensiSvit ofTe ^ was 

culture rather than the fineness of hi, discHn?“' 

-3uch, for example as ecrnl 'l‘^^™i‘natmns ^vlthin .sonic cntCLrories 

(favorite categories witli many candkhtesTTr ™”^'""''‘^«tion 

nil sorts of detailed information S I ' ' “'’ked f„t 

nored other important areas such is ■ '-'l completely m. 

tions food supply, and the’likc. deserved w fel^Vl 

who requested Information kt- 

Map Memory Test._WK„„ n 

77d,=.chanJidu=r“i, 

fece down on the desk. The eximine. L place, | 

tions for the Map Memory Test, I"'o«cderI i„ give the imstruc- 

you have jus[ Lde a s«r« r^sarmt' whh a'" t 

of the territory you will be covering Put time " '"aP 

you for only a few minutes whl tl r^ "'k'' 

and take the map with him. As a m.iLr of IVv' '^cn leave 

eight minutes to look at the map. Since it vluM k y"" ''avc only 

you, you cannot take notes or rliake sL chTr 1?' i^kh 

you must look it over as thoroughly as notible'^^' ' 
to be important, so commit as rLv as possible of" i'"'' 

take^;;? Ses^'tys^^^^ ikh m;,; ti'“:,’;, 

oxaminc the map (see 

of multiple-cholce statements Le ml. ''’"king at it any nmre. Sets 

•1- - 'sjsi- "" 

*■ “p »'«='. y« 

?onr- '“keled a, b ' j , y'"' '' P"»ib!e com- 

conclusion for each statement and then [ila:!, P'=k out the correct 

otter on the separate answer shee Anv appropriate 

have twelve minutes. All right, go ahead.^ou 
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10 


MAP MEMORY TEST 

1 . The town nearest Wilburn is (a) Martown (b) York City fc) Danville 

(d) Laketown (e) South York City 

2. The distance from Martown to York City is most nearly (in miles) Ta) c 

(b) 12 (c) 19 (d) 30 (e) 46 ^ ^ ^ 5 

3. In relation to the airfield (a) hill #2 is south (b) the submarine base 

js northwest (c) Wilburn is northeast (d) the power plant is southeast 

(e) Martown is north 

4. The place that cannot be reached by railroad is (a) the ammunition dumns 

(b) Laketown (c) Wilburn (d) die seaplane base (e) Martown ^ 

5. The supply dumps are nearest to (a) Danville (b) the seaplane base 

(c) the submarine base (d) York City (e) Wilburn 

6. Anti-aircraft batteries are located at (a) the ammunition dumps (b) the 
dam (c) the arms plant (d) the shipyards (e) hill :fpi 

7. In relation to the gun emplacements (a) South York City is south (b) the 

r,h“ •' (<>) ■>“ pi™ 

IS east (e) the supply clumps are northeast 

8. The area that can be reached by train but not by car is (a) the submarine 
base (b) the airfield (c) the seaplane base (d) hill (e) Danville 

9- e ength of the large lake is most nearly (in miles) (a) 5 (b) 

(c) 15 (d) 20 (e) 25 ^ \ J i ID) 

10. The name of the city closest to a hill is (a) Danville 
(c) York City (d) South York City (c) Wilburn 

11. The direction from the large lake to hill #i is (a) north 
(c) southwest (d) south (e) southeast 

S' s s ‘irs 

'’■ S'rS" '“p '■ (») ■ 

“V 7 S‘‘n™ ™ 

&“) 17 “I % : “ 

.«.Th=^ke,k. HP. #, H (.) 'si (h, 

(») V.rk Cic, 

^0. The place nearest the wcodV irfa) f 
houses (c) Wilburn (d) South 1 (Tf ^ 

III ™ the rSs "S , 

22. The dam is nearest to (a) hill *2 fh\ 5 

(d) Laketown (c) the warehouses*' 


(b) Laketown 

(b) northwest 
W (c) I 

(c) Laketown 
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Map Memory Test {Continued) 

23. The facility that is least protected by anti-aircraft or searchlight defenses is 
(a) the supply dump (b) the railroad yards (c) the power plant (d) 
Martown factories (e) the warehouses 

24. The smallest city in the area is (a) Martown (b) York City (c) Danville 
(d) South York City (e) Laketown 

25. The ammunition dumps are nearest (a) York City (b) Wilburn (c) 
Laketown (d) Martown (e) Danville 

26. In relation to the seaplane base (a) the warehouses are southeast (b) hill 

is northeast (c) the supply dumps are northwest (cl) the swamp is 
southwest (c) Laketown is south 

27. Tlie distance by railroad from Martown to Wilburn is most nearly (in miles) 
(a) 12 (b) 18 (c) 24 (d) 30 (e) 36 

28. The town nearest Laketown is (a) Danville (b) Wilburn (c) South 
York City (d) Martown (c) York City 

29. In relation to Wilburn (a) hill is northwest (b) Martown is north 
(c) the river is south (d) the airfield is northeast (c) the gun emplace- 
ments arc south 

30. Searchlights without anti-aircraft batteries arc located at (a) the sub- 
marine base (b) the arms plant (c) the shipyards (cl) t]\c ammunition 
dumps (e) the seaplane base 


The candidates were allowed at least twelve minutes to indicate the cor- 
rect completions on their answer sheets, If a candidate had not finished at 
the end of twelve minutes, he was allowed more time unless it was felt that 
for some special reason, such as a language handicap, he would hold up the 
group too long. For such a candidate, the group norms were of course 


inappropriate, 

In this test, as for all paper-and-pencil tests used at S, a distribution curve 
of raw scores based on a sufficiently large number of cases was plotted and 
periodically revised, on the basis of which raw scores were converted into 
ratings on our standard six-point scale. These ratings furnished another 
measure of the ability of candidates to observe and to report. 


Mechanical Comprehension Test,— As another measure of intelligence, 
especially as a measure of innate ability to understand physical principles 
in everyday situations, the Bennett Mechanical Comprehension Test was 
given to the candidates immediately after the completion of the Map Mem- 
ory Test. 

The need for a test of mechanical comprehension in the battery of intelli- 
gence tests employed at S was obvious, for many of the candidates were 
being considered for field assignments in which a knowledge of physical 
and mechanical principles would be absolutely essential. Since each item in 
the test consists of a plainly and clearly labeled pictorial illustration and a 
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short, simply worded question, even candidates with moderate laiuruatre 
handicap had Iitt e difficulty with it. Experience with the test sfKin indtuec 
that for the population at S, the first eight items could lie omitted as nondk 
criminating and the remaining sixty-eight administered with a fiftcen-min 
ute time limm Ideally, it would have been preferable to use it as an untied 
ability test. However, even with the time limit neccs,sitatcd by the limiti- 
tions of the schedule, it yielded a very wide range of scores, ami its low cor 
relation with other paper-and-pencil tests indicated that scores on it were 
little influenced by any verbal factor, 

d^StrsTerhrerfmm'a f skills of candi- 

ih™ J from an examination of two pieces of iiropauanda which 

they were directed to devise for the purpose of disturbing and loweir; 

Mway Manchuria 

Tesrr S (about an hour after they had taken the^OWI 

n^of Tr nf' complete 1 w Z 

r.M 0 the ollowing day. In order to standanlixe tlie proldei as mtfeh ' s 

Lt nb g'^'cn a printed outline containing b.ackground 

fa U about the country and people of Manchuria a.irl a list of i^ c 

ffi to"- “TT , P^°P“g*'>”da, though he was also explicitly 

A to fv 1? ‘f think of tiem 

Actually most of the papers produced by the candidates differed only in eh 

ditionTdLurbing K."“ propagandists conceived ad- 

South Manchuria Railway. ^ employees and guards of the 

‘I’”' '’'“d- 

.p.n, ,l,oi To hoS; ' i PT‘- 

vated and perhaps pedestrian candidate ** P^'’P“R='nda, some highiy mod- 

althougl/the markhg^ (oTthe^Lty^sLS ^''^1 

was a relatively constant framp nP * r was subjective, there 

these papers the staff member c r ^rencc. To guide himself in marking 

efficient of .66. In several cases ho^wv*"^ l° yielded a reliability co- 

as two steps on the second scorino- T ^m^e was^ changed as much 

where the ability to write or to ‘^'’uclal instances 

lity write or to evaluate propaganda was an essential part 
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of the camliclatcs proposed assignmem, liis papers were also read and evalu- 
ated l.y tlie other members of tlie staff who were responsible for the final 
report on ilic caachcliUc. 

With the hour of testing over, candidaies scattered, some to their inter- 
views, others to eN-pIore the terrain, others to work on the Manchuria nroh- 
lem, and still othm in a ifroup to an indoor situational test known as Dis- 
cussion, in which, before the afternoon was over, all subgroups of candidates 
would have participated. 

Discu,ssion.™This was a panel discussion set up to observe candidates in 
a situation which called for verbal resourcefulness. In many ways. Discussion 
was the indoor, verbal counterpart of the Brook. I-Icre again the candidates 
were tailed uiion to work together toward a common end, as a group, with 
no leader designated, hut tills time with difTerent tools, Having grouped 
themselves around a table, and facing the staff team that .sat at the other end 
□I the room, they V'crc iivstruclcd jis folluw,^: 

minutes, we should like you to di.scuss the fallowing ques- 
tion. What are the ma)cr postwar problems f.icing tlie United States and fif 
you have time) along what hne,s do you think they should be solved?' This is to 
be a group discussion. Hie ohjeet should he to allow each man a chance to 
express his opinion, to discuss these opinions, and to arrive at some conclusions 
With which most of you agree. Just licforc the end of the period, we should 
hke one of you to give us the conclusions of the group. 

During the discus, sion most of the candidates would make some contrlhu- 

hl f ? ri: ' Intelligence as reflected by 

nof-’n ^now ge and understanding of current events, contemporary 

national issue-!, and international problems. Their teamwork and tact in dis- 
cussing conflicting views allowed a rating on Social Relations, while their 
etto^s to guide the potip toward the goal provided a basis for rating Lead- 
ership, As m all situations, the Energy and Initiative variable was also 
observed and rated. 

At the close of the allotted time, the summary was presented to the staff, 
whose members noted how the .speaker obtained the role and how well he 
organize! the available material. Tben the candidates were asked to vote 
on a secret ballot for the man or men they con.sidercd most persua,sive and 

the man or men they would wish to have as their chairman in an assumed 
lutLirc discussion. 

There were many ways in which a group might begin in this situation. 
Utten a member of the group would suggest that a chairman, and perhaps 
a so a secretary, be appointed; sometimes these roles would be assumed by 
individuals without awaiting nominations or election. Some groups were 
concerned with outlining topics for discussion and with organizing their 
work as efficiently as possible at the very beginning, while others broke at 
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once into the discussion of a single postwar problem, such as the ncial nn^c 
t^ion, with no concern for what might follow. Often the discussion u? ? 
e un erta en by two or three of the group and only considerablv kt/ 
would others join in. Some groups would devote themselves to one ton"' 

™"5= I" ™<l 'Vide in ,hA 

Regardless of the approach of the groups to the problem, individu.,1 m.,. 
fcrs »t.in obvion, rolcsh Jen, Low”;;”™! 

•nd paaive listeners. Clear<nt differences would frequently lie oi,™.! 
some were tntelligent and well informed, others obviously naiVe toT 
peoeneedt some were pleasant and ftlendly, o.bets hostilc’^X^Ltlfo;”: 

what he saJas wtlltst whlftj'lS 

Bie?CTan™IniSve\'ad^b““o 7 f"”"'"''” indicators'of 

mo,e7eiaIl,“:S.tA Z^Z 't '7'" ” 

l^^eS'Tea'K; iruH'" l"’™' -=i“ 

cussion, not'beaus^'^fTlade'of b'eh" ''l' 

of that-but bec’uTe rf an i" “ >vtts plenty 

heard or saw. After all, it was J Lmcm o/' 1°^ "’'“.'"b' '*« 

social, economic, and politi d nrobkm !5 

and at the same time be sure thft hi r '"taHigcnt 

ment? If our disagreemeotVin r! P r ^ his jtidg- 

anything, it was probably that to som! ^his situation meant 

seemed more intelligent than a smarp .^.""hcis of the staff a stupid liberal 
the content of economic social and ^ fnrtimaiely more than 

this situation, and Zn the meaning ^ ‘'’R‘'«^™tmts was to he rated in 
there was more unanimity and comemi intelligence 

The vocabulary that a man used the 7 sigreement, in our ratings, 
■nanner In which he or^dS ,‘'7'"'’ °f ‘"'“"“"o" dfapo-sol, L 
g^ments. the level ofZ don J ee™ l' 'T™' “r"''""'!’ •>“ 

portittenee of his rematks ,0 "he 17 7 u“" >'>' 

■ which he grasped the implieatiotis of whst othlls 'b' speed with 

His ideas, the degreel whieltirtZli aXS 
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tli6 needs of the group in their handling of a problem, the use to which he 
was able to put, for group aims, the contributions of others, his resourceful- 
ness in suppoiting his own ideas and in refuting arguments brought against 
them these were but a few of the many signs of intelligence upon the vary- 
ing degrees of which we found it not too hard to come to agreement in our 
ratings. 

In thjs situation, as in many others, there was bound to be a high correla- 
tion between Leadership and Effective Intelligence, but the ways in which a 
man might demonstrate qualities of leadership were indeed various. Al- 
though it was characteristic of the leader that in some sense he organized 
and guided the group in its discussion, he could do this by acting as a mod- 
erator who simply coordinated the ideas of others and .summarized them for 
the group, or by actively initiating ideas for discussion and leading the 
group by the very forcefulness with which he handled topics. Whereas one 
leader immediately suggested a way of organizing the discussion, got every- 
one to express his ideas, and then outlined a method of procedure for han- 
dling these contribution.s, another took charge only after the discussion had 
proceeded for some time without a leader and sometimes only when the 
discussion wa.s in danger of disintegrating completely. Of course, at times 
a man was elected leader by formal vote of his colleagues, though this was 
no assurance that he would exercise that lcadcr.ship effectively or be able to 
maintain it for forty minutes. Certainly the mere choice of a man as leader 
was no sign that he possessed the necessary ability. Often the choice was de- 
termined by some unique characteristic of the individual, such as his greater 
age or white hair, which made him stand out as a ^Dcrsonage. 

To summarize the more frequently observed manifestations of effective 
leadership in this situation, we might say that the good leader commanded 
the respect of his colleagues by his confident and convincing discussion of 
topics, and by skillful means he encouraged their particip.ation and coopera- 
tion, making certain that each man had a chance to speak; he coordinated 
the various opinions of others and from time to time summarized them suc- 
cinctly for approval by the group before moving on to new topics; he pre- 
sented his own ideas in such a way as to excite others to a greater degree 
of involvement in the discussion; he saw to it that the discussion was com- 
pleted within the limits of time set by the instructions and in doing so was 
ever watchful for digressions from the central points of the discussion, keep- 
ing both himself and the group oriented to the task at hand, and though 
capable of being both assertive and forceful in leading the group, he knew 
when to defer to the wishes of others and was not afraid to do so. 

One more variable was rated in this situation, namely. Social Relations. 
Cooperation and good will marked the man with superior Social Relations. 
He was tolerant of the expression of opinions with which he did not agree, 
and no matter how forcefully he might attack them he never did so with 
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meanness or malice, and never with ad hominem argiinicnLs. Just ns he was 
fair in his criticism of the views of others, so he aceepiecl willingly and 
pleasantly criticism of his own opinions. He was patient in hearing others 
out, courteous and considerate of his colleagues in their attempts to present 
views even though they clashed with his. More reliable than any other sitm 
perhaps was a good sense of humor and an ability to laugh at himself In 
contrast to this type, die man with poor social relations often took himself 
Wo seriously; he was inclined to be too argumentative, dogmatic in express- 
ing his views, unwilling to listen to others or to yield on a minor tioiiu for 
the sake of unanimity. There were also many whose relations witli others 
were neither strikingly good nor obviously bad. For the most part, they were 
quiet, somewhat diffident individuals who said little and annoyed no one. It 
was clear that discussion was not their forte. 


When this situation was over, it was interesting to compare the behavior 
of the candidates and the roles they had played in the outdoor morning 
tasks as coinpared to this indoor afternoon di.scussion. There were s(.me 
wlw excelled or led in both types of problem; otiicrs who, though outstand- 
mg in one sort of situation, were completely at a lo.ss iti the oilier; and still 
others who were ineffectual in both. Something of the generality or sped- 
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Instnictions for the Interrogation Test (Escaped Prisoner).— Through- 
out the history of the assessment program, various procedures were devel- 
oped to rneasurc the skill of eliciting information in an interview and the 
ability to niakt use of the information so gained. During the last months 
of S, we em[)l()yctl a test of thivS nature, appropriate to the current military 
situation and having as its imaginary locale Central China. Since this pro- 
cedure required the attention of two staff members for each candidate ob- 
served, it was given only to those men who had been selected for intelligence 
work. These selected men were called together at 6:15 p.m. and given a map^ 
and the following instructions; 

A tail gunner, one of ten members of a B-29 crew which had made a crash 
landing, escaped from a Jap prison camp where he had been held for three 
months. Damage done by an air raid and the subsequent confusion enabled 
him to escape. In nearly two days he covered fifty miles or so before he was 
picked up, near Ankong, by a scouting party of the Chinese Nationalist 6oih 
Army, which was returning from the Nantze River sector nearest Kiantang. 
The scouting parly has brought him to the combined U.S.-Chincse Military 
Intelligence Oflice in Chaofu. 

You arc to question the tail gunner T/vSgt. Smith, for the purpose of finding 
out and reporting to intelligence headquarters: 

(1) the location of the camp where Smith was held, 

(2) information regarding treatment of prisoners, 

(3) information regarding size of camp, 

(4) any other intelligence deserving of report. 

The candidates were told that each of them would have twelve minutes 
to interview T/Sgt. Smith on the afternoon of the following day. As they 
were told, the purpose of forewarning them was to give them time in 
which to prepare for the interview. 

Stress Interview. — This procedure was designed primarily to test the 
candidate’s capacity to tolerate severe emotional and intellectual strain, The 
strain was created by rapid and merciless cross-questioning under disagree- 
able conditions with the aim of detecting flaws in a cover story which the 
candidate had been given only a few minutes to invent, 

The method of conducting the test was as follows. At exactly 6:25 p.m. 
the whole group was assembled in the clas.sroom and to them one of the 
members of the staff made the following statements: 

This evening we arc going to conduct one of the most important tests of 
the whole program. What you are to do is simple, but it is necessary for the 
success of the procedure that you carry out every detail precisely. It is par- 
ticularly essential that you be completely punctual in following the schedule 
set for you. Beginning at 6:30 you will go one by one into the small room labeled 

^The map was the same as that used ia the SIX-3 Test (see page 143). 
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A-13. Each of you in your individual schedules will find the time of your own 
appointment recorded. In the room will be a clock and a set of directions on 
the table. You tvill remain there alone for exactly twelve minutes, re.iding and 
carrying out the directions. Are there any questions? 

By the time these instructions had been given it was about 6:30 vm, 
and at that hour the first candidate went to the little room, where, on enter- 
ing, he found the clock on the table together with a paper on which the 
following was written: 


INSTRUCTIONS FOR RESOURCEFULNESS TEST 
Read these Instructions carefully. 

The examination you are to undergo is designed to test your resourcefulness 
agihty of mind, and ability to think quickly, efiectively, and convincingly. This 
IS an important test and it is important that you do well. In twelve (12) minutes 
report to the basement room at the foot of the stairs. 

The test will measure your ability to establish and maintain a cover story for 
the situation outlined below. Your cover story must be told convincingly m. 
telligently, and clearly.^ The examiners will try to trip you up on your Vtory, 
to lead you into inconsistencies, and in general to confuse you. ^ 

Several students in the past have failed in this test kcm.sc they forgot or did 
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from within caniinanclcd him tcj enter, and on complying he found himself 
facing a spotlight strong enough to blind him for a moment. The room was 
otherwise dark. Ikhincl the spotlight sat a scarcely discernible board of in- 
quisitors, several members of the stad. The iiucrrogator gruffly ordered the 
candidate to sit down. When he did so, he discovered that the chair in which 
he sat was so arranged that the full strength of the beam was focused directly 
on his face. The questioner then addressed him as follows: 

If you had an innocent reason for being in the building where you were 
caught, we expect you to be able to give it to us without any hesitation. We 
warn you, however, that any statement you may make will be subjected to a 
searching examination, so you would do well to be very careful in what you 
tell us, and also very accurate, Our first question is, *‘Why were you in that 
building?"' 

In reply the candidate dicn began to tell his story as he had devised it. 
Perhaps he made use of the cover identity which he had been developing 
for himself ever since the security talk given on his arrival at S. Or perhaps 
he fabricated a whole new talc which he thought would explain more satis- 
factorily why he was discovered investigating a secret file. Whatever his 
story was, it was scarchingly examined as soon as he had told it. 

At first the questions were asked in a quiet, sympathetic, conciliatory man- 
ner, to invite confidence, Frequently this led the candidate to let down his 
guard and expand his story, adding unplanned details on the spur of the 
moment. After a few minutes, however, the examiner worked up to a 
crescendo in a dramatic fashion. Any error, slip of the tongue, forgetting, or 
even halting response was likely to be seized on by the examiner as a suspi- 
cious sign. When an inconsistency appeared, he raised his voice and lashed 
out at the candidate, often with sharp sarcasm. He might even roar, “YouVe 
a liar," or some such phrase, if a falsehood in the cover story became appar- 
ent, Sometimes, after such an outburst, the questioner might lapse back into 
his soothing tone and suggest that it was understandable that such a false 
statement might be made if the suspect wished to cover up in order to pro- 
tect his family. Occasionally the candidate would bite at this bait, and agree, 
whereupon the examiner would burst out accusingly, yelling, ^‘Now we have 
the truth— you admit that you lied." 

At the beginning of the grilling the questions were put slowly and 
smoothly, but as the end neared they were hurled in rapid-fire, staccato 
fashion, The questioning was shifted quickly from one topic to another 
and then back again in a very confusing manner. Beginning with generali- 
ties, the question soon forced the accused to give particular, specific infor- 
mation. The accused was asked about exact dates, hours, addresses, telephone 
numbers, and proper names of people involved in his story. Later he was 
questioned on the wider field of his past life, his profession, his place of resi- 
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dence, and so forth. Many of these items he had not, of cour.se, had time to 
work out in the twelve minutes immediately preceding the questioning, .so 
he was forced to improvise answers on the spot. 

Another stratagem, often employed by the interrogator in an effort to 
confuse the victim, was to repeat, after a lapse of a minute or two, details 
of his testimony incorrectly; for instance, rearranging the numerals in a 
telephone number or Army serial number, in order to see if the candidate 
recognized the change and also to fill his mind with a bewildering mass of 
figures. Sometimes, too, the questioner could make a suggestible candidate 
contradict himself by asking him a number of leading questions, to each of 
which he agreed, until the questioner could at last jump on an inconsistency. 
For example, by this technique, a candidate could often be made to agree 
that he had no dependents, that he was healthy, that he was a citizen, and 
that he was not in an essential industry or the Armed Services. If he were 
then asked, "What is your draft classification?" there was almost no reply 
he could make without involving himself in a contradiction. Or by a similar 
procedure it was sometimes possible to get a candidate to atlniit that he had 
arrived in Washington some days or weeks before with little money, and to 
lead him to deny any sources of income while he tvas in the city, and then 
suddenly to ask how he had supported himself while in Washington. 

An effort was also made to keep the suspect tense by not allowing him 
to relax. He was made to sit upright in a hard chair. If he was smoking he 
was told to stop. If he crossed his legs, he was told to uncross them. If he 
lowered his head to avoid the light, he was commanded to look up. If he 
wore glasses, he was directed to take them off. All this served to keep him 
from attaining a comfortable position, so adding to his stress. 

After ten minutes of such grilling the examiner broke off the question- 
ing abruptly with a dissatisfied air, saying, “We now have abundant evidence 
that you have not been telling the truth. That is all.” Then the board of 
staff members whispered together for a few seconds as if arriving at a 
verdict. Finally the examiner asked solemnly, “Your name is Buck, isn’t it?’’ 
When the candidate assented, the interrogator announced, "It is our decision, 
uck, that you have failed this test.” There were then about five seconds 
of silence while the candidate’s reaction was observed. Occasionally he 
would burst out at this pronouncement and protest, but more often he 
accepted it silently with some slight sliow of emotion. Then the examiner 
directed the candidate to go immediately up to a rewm on the third floor 
to see one of the members of the senior staff. Thereupon the subject left, 
to go to the Post-Stress Interview. After he had gone, anti before the next 
subject was admitted, the staff observers rated the man who had just left 
e room on t e personality variables of Emotional Stability and Security. 

As usual. Emotional Stability was judged by the degree of control and 
poise exhibited by the subject, as well as by the extent to which he seemed 
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to remain free of neurotic traits when placed under stress, Searching for 
evidences of tension, the staff members noted whether the candidate sat 
rigidly in his chair, wdicther he moved abf»ut restlessly, whether he smoked 
nervously, whether lie played with fjbjccts in his hands or with his fingers 
or fingernails, whether he paid much attention to the bright light, and how 
he reacted to the sudden sliouting of tlic examiner. The candidate was also 
watched for signs of autonomic disturbance, such as sweating, (lushing, 
swallowing, or moistening of the lips. Otlier common signs of emotion were 
stuttering; blocking of speech, sometimes fcjr many seconds; explosions of 
anger; weeping or lacrimacion; and characteristic changes of facial expres- 
sion, particularly when the candidate was told he had failed. 

Positive indications of good Emotional Stability were judged to be an air 
of calm and dignity, little reaction to shouting or an insistence that it was 
not called for, quick responses, an aggressive effort to control the inicrvicw 
and prevent the questioner from talking down all opposition, and laughing 
or joking. Sometimes suspects would ol)viousIy appear to enter the spirit of 
the grilling and act a role, even on occasion pretending to appear frightened, 
as they would admit when the examination was over. Such behavior was, of 
course, a sign of emotional control rather than the contrary. 

The rating of the candidate’s ability to maintain Security wa.s based on an 
estimate of his cautiousness, inconspicuousness, skills in misleading and 
bluffing, and rcs'ourccfulncss. Also taken into consideration was whether his 
story was plausible, ingenious, and original, as well ns whether it followed 
the directions given him. 

In conclusion, it should be pointed out that the Stress Intcrvicvv was dc- 
signed primarily to measure emotional stability under strain, w^hich is a 
factor to be evaluated in sSclccting personnel or making a diagnosis of per- 
sonality. The situation lent itself admirably to our specific project of testing 
men who were being selected to do intelligence work, however, and this 
fact determined the specific characteristics of the procedure. Many of the 
candidates might some day have to live under cover, or their work might 
possibly involve them in a situation in which they would be either inter- 
rogator or suspect in a grilling of this sort. 

Mild as this situation may seem from our description, it was nevertheless 
sufficiently strc.ssEul to arouse in some of our subjects crippling and incapach 
taring attacks of anxiety, and sometimes in just those candidates who by 
background and experience might have scenacd most admirably qualified for 
undercover work. One refugee from Europe, who had had a brush with the 
Gestapo and had so skillfully come through the questioning to which they 
had subjected him that he was allowed to go free, became very mucli dis- 
turbed in the Stress Interview. In Post-Stress he asked to be released from 
S and from any commitments to the OSS. Attempts to quiet him were of 
no avail. The emotion. stirred in him by Stress kept him awake that night; 



138 


Assessment of Men 


and the next morning his anxiety had reached the point where, in another 
situational test, he fainted. It was clear that it would be unwise to force him 
to finish the assessm^t program since he was completely unfit to operate in 
Europe under cover. 

Another candidate, who as a boy had endured many hardships in Russia 
during World War I and during the Revolution, could not tolerate the 
emotions reactivated in liim by the Stress Interview. Before his assessment 
was completed he, too, had to be returned to Washington and his home. 

The mere instructions for the Stress Interview could serve as a most re- 
vealing projective test, as indeed they did strikingly on one occasion when 
a man, after reading the instructions, insisted that he could not go through 
with the test. A little later the director of S found the candidate in his bed- 
room, sitting on the edge of his cot, sobbing. Upon reading the instructions 
he had imagined that on reporting to the basement he would be beaten by 
the staff, and he was overcome with fear that under this provocation he 
might commit some extreme act of violence. As he talked with the director 
about some of his early experiences, a few of the factors responsible for his 
unusual reaction became clear, but the anxiety aroused by his fantasy con- 
tinued to increase until, in his case, too, it seemed wisest to excuse him from 
the rest of the program. 

Post-Stress Intejriew.— It is a maxim of secret agents and investigatons 
that security breaks occur most frequently when a man is enjoying a moment 
of relaxation after a period of tension, for under such circumstances his 
inhibitory mechanisms are momentarily in abeyance, and he is off guard. 
It was our belief, therefore, that a candidate’s ability to keep cover would not 
be adequately tested unless an effort were made to get him to reveal true 
facts about himself at a time of relaxation after tension. Consequently, im- 
mediately following his Stress Interview and the shock of hearing that he 
had failed, each candidate was told to report to a member of the staff on the 
third floor. There he was cordially greeted and made to feel at case in the 
company of a sympathetic listener who, despite his innocent manner, would 
actually do his best to induce the candidate to break his cover. Though the 
chief purpose of this situation was to test the candidate's security, it served 
two other ends: it provided an opportunity to estimate the strength of the 
candidate’s motivation for his proposed assignment, and his emotional stabib 
ity. The Post-Stress Interview also allowed for catharsis of emotion and for 
reassurance of the candidate about his performance in Stress and Post-Stress. 

The schedule was so arranged that there was no waiting between Stress 
and Post-Stress Interviews. Each candidate went immediately from the base- 
ment to the third floor, where he was greeted by an interviewer, who talked 
with him for ten minutes and then sent him on his way before the next 
man arrived. 
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The room in which the Posi-Strcss conversation took place was one of 
those on the third Honr in which candidates knew that Personal History 
Interviews were held taidcr X conditions. As a coixscqucncc, although all 
candidates had been sj)ccilically directed not to mention any faces about 
themselves cxcc[)t under s|>ccifically designated X conditionSj they drifted 
easily, in tliis setting, into a discussion of past events. Afterward they often 
admitted, sometimes in an attempt to excuse their security breaks, that it 
was the room, as much as the manner of the stall member, that led them 
to fall naturally into a feeling of intimacy and a mood for confession in the 
Post-StrevSs Interview. 

From the moment the candidate arrived upstairs, the interviewer did 
everything possible to encourage case and relaxation after his stressful ex- 
perience in the basement. He pointed to an easy chair and said hospitably, 
“Sit down and make yoursSclf comfortable," He offered him a cigarette 
and himself lolled back informally in his chair. Then he asked in an off- 
hand manner, "Well, how have things been going?" The question was 
phrased in this vague way in order to get the strategic advantage of having 
the candidate make the first reference to the Stress Interview. Two things 
were gained by this maneuver; first, it served to dissociate the Post-Stress 
and Stress situations, so helping to beguile the candidate into letting clown 
the guard he had developed in the earlier test; and second, it enabled the 
interviewer to gauge, from the rapidity and vigor with which the candidate 
referred to the former test, tlie degree of his emotional involvement in it. 

Almost always the candidate re[>ortcd at once that things were going very 
badly, that he had just failed a very important test. The way in which a 
candidate said this— whether he interpreted it as failure in a single Lest or as 
failure in the whole assessment program— revealed much about his motiva- 
tion for work in the OSS and his ability to tolerate failure and frustration. 
The emotion or lack of it with which he spoke, as well as his willingness 
or reluctance to discuss his experience, was noted. In any case, the inter- 
viewer, on being told of the failure, sympathized with the candidate, but 
not unduly. 

The candidate was then asked how it had happened that he had failed. 
Some, by their replies, would indicate a subservient attitude to authority; 
others, an outspoken skepticism that they had failed; while still others re- 
vealed the kinds of alibis and rationalizations they were inclined to use to 
explain their failures. Whatever the reply, the interviewer pursued this 
topic further by asking the candidate how well he had felt he was doing 
while being grilled. Replies to this question frequently revealed not only a 
candidate’s ability to make a dispassionate judgment at such a moment, but 
also how eager he had been to succeed in the Stress situation. From this, 
some indication of his motivation could be obtained. 

Usually the interviewer sought next to investigate the kinds of errors 
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which the candidate had made in Stress— this Uj trap the unsuspecting 
candidate into breaking cover. He might ask, ‘'What details did they man- 
age to trip you up on?’‘ or “At what points did you iiiul yourself treading 
on thin ice?” In reply, the candidate usually gave concrete examples oi 
confusion or near confusion in his story, although occasionally one claimed, 
truthfully or not, that he knew of no flaws that were discovered in his 
story. What he replied was of little importance, for in either case the ques- 
tioner’s purpose had been achieved: the topic now concerned details of the 
cover story. Taking advantage of this transition, the interviewer said, em- 
ploying some flattery if he believed it would be effective in the given case, 
“Of course, it’s really impossible to think out all the aspects of a cover story 
in twelve minutes. If it could be done, Vm sure you would have done it. 
Undoubtedly you used the device of employing experiences from your real 
life in constructing your fictional story, though of course so jumbled that 
no one could identify you.” Almost invariably die candidute agreed that he 
had, whereupon the questioner asked in a matter-of-fact tone, “Just what 
events did you use from your real life and how did you alter them? I’m 
interested in the technique you used ” At this point many a candidate broke 
cover. 

The interviewer was always on the lookout for any slight evidence in the 
candidate’s expression, actions, or manner of speech of his becoming suspi- 
cious that an effort was being made to break his cover. If no such signs 
appeared, the interviewer forged ahead in his efforts to get facts about the 
candidate’s real life. If signs of uncertainty did appear, he immediately took 
steps to allay the candidate’s suspicion by changing the topic. He wished to 
forestall any queries about X conditions at this time so that he could return 
to the attack later with more hope of success. If the subject actually began 
to ask whether X conditions prevailed, the interviewer interniptcd the sen- 
tence if he could, or if this was not possible, he would give some vague 
answer such as, “Things are just as they were downstairs,” and hurry on to 
another topic. A determined and alert candidate would, of course, not be 
trapped by this, but would insist upon a definite answer to his question. In 
such a case, the interviewer would admit that X conditions did not prevail. 

The topic to which the interviewer turned the conversation whenever the 
candidate’s suspicion forced him to change it was an explanation of the pur- 
pose of the interview. “The test downstairs is a fairly new test," he would 
say, “and we hope it is a good one. However, we need the comments of men 
who have experienced it and who know something about it, and therefore 
I have asked to have you sent up here. I should greatly appreciate any 
criticisms you may have of it or any suggestions as to how it can be im- 
proved.” This maneuver changed the line of the candidates’ thought so 
radically that, in an effort to think of criticism, he often forgot about the 
perplexing problem of X conditions. 
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After the candidate hud made some comments on the test, the examiner 
inquired, “Have wc succeeded in creating a stressful situation downstairs? 
How did you feel during it? Did die grilling upset you?’' In his replies to 
these queries the candidate revealed much about his emotional stability, and 
this topic was pursued as long as it appeared to be fruitful. 

Then came anotlicr transition, again for the purptisc of going to a field 
in which it was easy to lure tlic unsuspecting into breaking cover, “Have 
you ever been in such a situation before?” the interviewer would ask. “For 
instance, were you ever cross-examined, as in court, or interviewed for a 
job? Perhaps you have clone ssome such interviewing yourself?” Treading 
gingerly, the questioner might try in this way to get information about the 
candidate’s vocation. If this failed the examiner might ask, “W.ell, in college 
weren’t you ever grilled like this in a fraternity initiation?” and, caught 
off his guard, the cantluiaie might reply that he never went to college or, 
conversely, slate the name of his college or even of his fraternity. 

Another fruitful issue to raise at this juncture was that of childhood 
events. The interviewer might say, “As a psychologist Tve been wondering 
whether there weren’t times in your childhood somewhat similar to this— 
times when you concealed petty things from your parents by telling fibs 
when they questioned you ” Most students would agree that there had been 
such episodes, whereupon the interviewer would ask, “Did your family 
make a great point of complete truthfulness and honesty? Perhaps you arc 
like some candidates wc have had at S who have found it difficult to make 
up a cover story because their early training in honesty made it hard for 
them to tell lies.” Often this approach led quite naturally into a discussion 
of the candidate’s childhood, his parents, and often his religion, 

If a further line of attack on the candidate’s cover was desired, an effort 
could be made to get him to reveal the branch of the OSS for which he 
worked. One way to do this was to ask, “Do you think this really is a good 
test?” After the candidate had replied, the interviewer might ask, ”Do you 
think it is a good test for members of your branch? By the way, which 
branch do you belong to?” 

Usually when these questions had been answered, the allotted time for 
Post-Stress was nearly over, so the interviewer asked if X conditions had 
existed during the conversation. Candidates responded to this in different 
ways, which gave excellent insight into their security consciousness as well 
as into their intellectual resourcefulness and emotional stability. Some looked 
stunned and guilty, admitting immediately that they had been caught, 
Frequently they were ashamed and distressed to realize that by breaking 
cover they had failed another test. Others bluffed at this point, or perhaps 
said correctly that all the facts they had related about their “real life” were 
false. (This could be confirmed from the Personal History Forms they had 
filled out the first night; indeed, all “facts” told by candidates in Post- 



1^2 Assessment of Men 

Stress had to be checked in this way, for a really clever candidate might 
“confess” to have broken cover in Post-Stress only to have a check of his 
story reveal that all that he had said was a cover which he had kept intact. 
Sometimes, it must be confessed, we did not know who was deceiving whom 
in the Post-Stress Interview.) Still others insisted that they had assumed all 
along that they were under X conditions, and gave a variety of reasons and 

rationalizations for making this assumption. u a u a 

The interviewer then told them, if they had broken cover, that they had 
erred in doing so and instructed them to be naore careful in the future, a 
lesson which most candidates thought had been well learned and which they 
took in good spirit. Those, on the other hand, who had gone tluough the 
Post-Stress Interview without breaking cover were complimented and told 


to continue the good work. i i u 

From this point on in the interview everything^ was done to help the 
candidate regain his equanimity and to prevent his becoming embittered 
toward the assessment program by the evening’s events, First he was ^ked 
how he had felt when he had been told downstairs that he had failed. Then 
he was questioned about how much he had wished to succeed in the test. 
After that he was told that it was very likely that he had not failed, and 
that as a matter of fact he probably had done very well. It was explained 
to him that all the candidates were told at the end of the Stress-Interview 
that they had failed, even if in reality their performances had been good. 
It was explained that such an announcement had been made to test their 
emotional reactions. Then the candidate was reassured and asked to pardon 
the staff for appearing to have been so inconsiderate, He was told that it 
was thought essential to see how well he could withstand such strain, and 
he was complimented on his control under these difficult circumstances. 
Finally, he was requested not to tell the other candidates what had occurred 
until all had been through both sessions. With this the interview was con- 
cluded, After the candidate had left the room, the Post-Stress interviewer 
rated him on the six-point scale on Security, Emotional Stability, and Mo- 
tivation for his Assignment in OSS, 

All told, more than half the candidates broke cover at one point or another 
in this casual relaxing interview which followed the high-tension grilling 
downstairs. 

The Stress and Post-Stress interviews of candidates were so scheduled 
that those men who had been recruited for work as intelligence agents and 
were being assessed for such assignments were free in the early part of the 
evening to be given, as a group, a test designed to measure the ability to 
evaluate and to abstract “intelligence” material. 


SIX-55 Test. — ^The materials of this test consisted of four documents which 
purported to be (i) a report on the interrogation of Chinese refugees sent 
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by a Chiaese colond in Military Intelligence in Chungking to an American 
major in G-2 stationed in the same city; (2) the translation into English 
of a captured report from a Japanese captain, cn route, to Major Shojiro 
Kobayashi, Propaganda Dissemination Unit, Shanghai; (3) a report on 
conditions in occupied territory by an American lieutenant in Nausha, 
China, to a major in 0-2 at Chungking; and (4) a translation 1 >i a Chinese 
military document sent from Kanchow to Chungking reporting on recent 
enemy activity in that sector; a map of the Central China front; a sheet of 
instructions; and an answer sheet. 

The instructions to the candidates read as follows; 

You are an aide in the Military Intelligence Division at a Pleadquartcrs 
establishment in China. A staff meeting is scheduled to start within a short time 
and one of the subjects to be discussed is the possible future action of the 
Japanese in the direction of Lingsien and Kanchow indicated on die map pro- 
vided. You arc operating under conditions of emergency where the available 
facts must be reported in the absence of time enough to wait for the whole 
story. The available facts in this case arc contained in the four documents 
and the map attached. 

For the purposes of this test the date of today is 15 December 1944, 

The test was composed of two parts. Part I, for which ihirty-fivc minutes 
were allowed, had two requirements. From the documents provided, candi- 
dates were instructed: 

1. To make a numbered list of all items of information bearing on future 
enemy action in the direction of Lingsien and Kanchow, 

2. Considering the source of the information and also considering how well 
or how poorly it agrees with other information in these documents, to make 
an evaluation of the truth, credibility, or probability of each item of information 
according to tlie following classification: 

A. Probably 'jtiue (reliable source and consistent with independent informa- 
tion from another source). 

B. Possibly true (reliable source and neither confirmed nor contradicted by 
information from another source), 

C. Rumor (known to be rumor, or from unreliable source, or contradicted 
by other items of information). 

Part II required that the candidates prepare a fifty-word dispatch trans- 
mitting the most significant information, to headquarters. In this part of the 
test, candidates were specifically instructed not to draw any conclusions re- 
garding possible enemy action, but simply to transmit the information they 
had gathered from the documents. For Part II ten minutes were allowed. 

Although these documents and map were fictitious, an attempt was 
made to render the test as realistic as possible by making Centra] China 
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the locale of the problem and by writing the four basic documents as nearly 
as possible in tlie style of the organizations whose personnel was suiinosed 
to have written them.'* 1 1 

Raw scores on Part I were obtained by allowing two points fur each item 
and one point for_ its correct classification. On Part II the raw scores were 
obtained by allowing two points each for the seven must significant items 
in the dispatch Norms were provided fur converting raw scores into ratings 
on the standard six-point scale. If the assumptions upon which the test was 
based were correct, the candidate should have earned a score that was more 
or less directly related to his ability to perform at least some of the operations 
involved in processing intelligence material. ^ 

SuccessU performance on rhe SlX-n Test required mote than a simnle 
listing of Items copied from the documents and a guess as to the credibility 
of each. Because of the time limit, the candidate penalized himself if he 

Ids dme ^ “ ' '' ‘“structions given and instead wasted 

ns time giving information not called for. Moreover, he could not decide 
lhat certain obscure items were relevant unless, to take one example he 
percaved the difference in content of two short items of propaganda.’ He 
no properly classify several of the items until he had read all four 
ocuments and compared those portions that referred to the same fact The 
regarding the time of the expected enemy action could be 
m de only through close attention to the dates of the documents and to two 

serieTof^Dr"'' '"'3 ''"'u production of one or two 

senes of propaganda leaflets by the enemy. 

Preparation for Teaching Test.— Sometimes during the course of the 
evening those candidates who had been recruited to t ve " T / , 

b= a kad B g.va a al.ort dem.natrauoaal lemuc aa a tcs,*£ Lk tcad „a 
ability. In most cases the candidate was given the task of evnll 

»nd usts ®£ ,ht tim, ndT“’j ‘■“‘T™ ““-’“uclion, (unclion, 

devierTh, «■> enlarged cross-scaional vkw of ,ha 

and a “ “ eeudv thia maLu 

talk L *"fellowke d°rH= “’'*'“,'1“'' “ ■" “'ttieiptition of hi, 
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men who were going to instruct natives in the field in the use of the time- 
pencil all they would need to know about the device. A half hour to an 
hour was sufficient time for most candidates to prepare themselves for this 
assignment. 

A lecture on the time-pencil was requested only from those candidates 
who had been recruited to instruct in demolitions, firearms, or some other 
weapon or instrument. Instruction in OSS schools was extremely varied, 
including such disparate subjects as cultural background, meteorology, in- 
telligence reporting, fieldcraft, mapping, and so on. It seemed best merely 
to ask instructors in such topics to be prepared on the following day to give 
a fifteen-minute talk on some aspect of their specialty, 

The program at S, up and through the evening of the first full day, was 
designed to keep the candidate under fairly constant tension. After this, an 
atmosphere of increasing relaxation and sociability was encouraged, even 
though the tempo at which candidates were confronted with new tests and 
situations did not slacken. As has been stated before, it was our intention 
in designing the S program to arrange that every period of unpleasant 
stress be followed by an opportunity for the candidate to release his cnao 
tion in the company of the staff member responsible for his situationally 
induced frustration or failure. It was in keeping with this principle that the 
member of the staff who had interrogated the candidates so unmercifully 
in the Stress Interview made it a point at the end of the evening to join 
the candidates in the living room. 

As the interrogator entered the room with characteristic exuberance he 
congratulated the group on its performance in the dungeon, Recognizing 
his identity, they would respond to his greeting in a manner that reflected 
their reactions to the test itself. Some of them would make critical or 
derogatory comments, others would reply quietly, smilingly, indifferently, 
and still others would rise to meet him with eager inquiries as to the quality 
of their performance. A few would remain aloof. 

There was usually at least one member of each class who spontaneously 
inquired whether the staff member really thought that their group had done 
well. It was such a question which evoked a discussion about the test that 
lasted for, perhaps, a half hour. The answer ordinarily was that on a com- 
parative basis the cover stories of the present group equaled those that had 
been considered best in previous groups. The interrogator would then single 
out a candidate in the group and laughingly point out, to the amusement 
of the other candidates, how he, the examiner, had been worsted by him, 
Then other cover stories would be reviewed, in the course of which weak- 
nesses in them would be glossed over or joked about pleasantly. 

The interrogator would then tell the class some amusing incidents that 
had occurred during previous Stress Interviews, some of them fictitious and 
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some aaggcrated, but all having for tkir purpose the amusement of the 
group, In e,icli of these cases the examiner placed himself in the suhordinite 
position. A story always received with satisfaction was tliai of a .stranoim, 
Texan who was ordered to uncross his legs by the e.xaininer, a much b 
powafully built individual. That command was hurled sharply at the 
Texan several times, hut was always ignored. Finally, the Texan looked in 
the direcuon o the voice and threateningly .said: “Come and make mel“ 
To enliven the proceedings further, the stall mcinhcr might parodv a 
candidates actions during the interview with exaggerated humor. Follow 
mg these reminiscences the candidates would usually ask further questions 
abut the test. Almost all became involved in attempts to learn what con- 
stitute accepta e raver stories, suitable ways of meeting unexpected ques- 
tions, and appropriate behavior in such circuinstaiiccs. The answers were 
general enough to encompass the performances of the evening and couched 

ley y ij' " 

And so, except for those who would continue to play cards or darts, or 
d, or listen to the radio or engage in further conversation in the living 
ora or in the kite en while raiding the icebox, or work on some ass J 

eTelfa t 'e”® 

evening at S came to an end. 



Chapter IV 

ASSESSMENT AT S; PROCEDURES {Continued) 


SECOND DAY 


Ac 8:30 on the morning of the second full day at S. candidates gathered 
in the classroom to be asked by a member of the staff to record on slips of 
paper before them two things, each in a sentence or two: (i) the basic facts 
of the cover story which the candidate had developed at S; and (2) a 
statement of his postwar plans. This latter report on what he would most 
like to do in the postwar world was to be given truthfully if it could be 
told without seriously breaking his cover; otherwise he was to record the 

activity w lie was most similar to that in which he intended to engage after 
the war, ^ ° 

^ These two bits of Information were gathered to aid the staff in preparing 
situations, tailor-made to fit each candidate, known as Improvisations, which 
would be held in the early evening of this day. 

Aside from the Personal History Interviews scheduled for some candidates 
the major procedure of this morning was a scries of situational tests in 
which each man in turn would be assigned the leadership of his group in 
the solution of an operational problem. 


ssi^ed Leadership._It was recognized early at S that situations like 
Brwk and Discussion afforded only a limited view of the ability of candidates 
to lead their fellow men. What was observed in these procedures was largely 
initiative and assertiveness, for it was inevitable that in situations in which 
no leader was appointed a premium would be placed upon just these 
attributes. Furthermore, a large number of candidates who sought to gain 
authority never attained it, at least to the extent which would allow them 
to demonstrate what they could do if placed in full charge of a project. 
Moreover, those who did succeed in directing operations were not always 
tree to exercise their planning, organizing, and executive abilities to the full 
since often right up to the very end the rivalry of others meant that they 
ad to devote a good deal of attention to the very maintenance of their 
status. While this type of leaderless situation was useful in identifying 
assertive men with a strong drive for dominance, and while it did yield a 
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measure of leadership in many cases, there was clearly a need for procedures 
which offered each man a chance to reveal his true ability when a position 
of authority was definitely assigned to him. 

In view of these considerations five assigned leadership problems were 
devised, each of which demanded a somewhat different type of command,^ 
Since there were usually more than five candidates in a group, one or two 
candidates, whose proposed mission did not demand leadership ability, were 
not assigned a problem. Each of the others was given the problem which 
seemed particularly suitable to him. 

The preliminary instructions for the Assigned Leadership situations were 
as follows: 

You are now going to participate in a number of field problems. In each of 
these you will work together as a team with one member assigned the role of 
leader. In each problem, we will tell you what the situation is, From then on you 
are on your own. If you happen to go beyond what we consider the necessary 
limits of the problem, we*ll let you know; so you can proceed as you wish unless 
we tell you otherwise. We will let you know when each problem is over. All 
right, let’s go to the first one, and let’s try to make each situation as realistic as 
possible. 

MINED ROAD.—The gfoup was then taken to a road where one candidate, 
in the presence of the whole group, was addressed in the following manner; 

Joe, you’re the leader in this situation. You’re leading this group back from 
a mission in enemy-occupied territory. You and your men have blown up a 
bridge about a mile away in this direction {points behind them). According to 
prearranged plans, you must meet a guerrilla truck about a mile away from 
here in this direction at a time which leaves you only ten minutes to spend 
getting across this road. You have discovered that this road has been mined 
with a new type of sensitive Jap mine which you won’t be able to neutralize or 
dig up. The limits of the problem are this: the road is assumed to be between 
these white lines, and you can work up and down the road as far as die white 
lines extend. The explosion at the bridge has aroused the enemy, but so far 
they don t know in which direction you have gone. Your problem is obvious: 
to get across and leave as little trace of your escape route as possible. O.K., 
go ahead. 

The distance between the white lines was approximately twelve feet, 
Bordering the road were trees and bushes, and scattered about near by 
were a twelve-foot and a fourteen-foot log, some stones, a few two-by-fours 
about four feet in length, and two lengths of rope. 

The problem which faced the leader in this situation was that of organiz- 
ing his men for action under pressure of time, and leading them across the 
road without setting off any of the mines. In accomplishing this, the material 

^Several of these situations were adapted from procedures used by the British War Office 
Selection Boards. 
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at hand could be used in any one of a number of ways; catching a stick, 
tied into the end of the rope, on the crotch of a tree on the far side of the 
road and constructing an overhead cable; tying or looping the rope over 
a branch of a tree above the road and using this to swing over die road; 
lowering a log against the trunk of a tree on the far side of the road in such 
a way that the base of the log was held securely on the near side, thus 
making an inclined bridge on which the group could cross; laying a log 
as a bridge on rocks on the far and near sides of the road, and so forth. 

The way in which the leader conducted the discussion of the various 
possible solutions gave the staff insight into his ability to organize ideas as 
well as to spur the group to the quick action that the situation demanded. 
Furthermore, since the authority for directing the project was given to one 
man, it was possible to get some idea of how well he could bear the respon- 
sibility of leadership, that is, how much and in what ways he leaned upon 
his men for advice; whether he retained his position or gave up a good deal 
of his authority to more assertive and more imaginative followers. 

The situation was also one in which the ability of men to work as willing 
and cooperative subordinates could be noted. Certainly it was fully as im- 
portant to know how our candidates took orders as it was to know how 
effectively they gave them, since all who were passed by S would have to 
fit into a military, or at least a quasi-military, chain of command. At the 
Mined Road one could observe whether a man placed in a subordinate 
position was cooperative and obedient, or lazy and refractory, whether he 
acted as a willing and effective lieutenant or hampered the Icndcr^s direction 
and the group’s effectiveness by his unwillingness to suppress his own ideas, 
or by his importunate desire to take over and direct the problem. 

When the assignment had been completed, with the group safely across 
the road, or when fifteen minutes had passed without a successful solution, 
the staff member in charge called the group together for a critique of the 
execution. He first inquired of the leader what he thought of his solution 
and in what ways, if any, he would change it if he had to do it again, The 
leader’s response gave some measure of his confidence in handling the 
project and his ability to learn quickly from the mistakes he had made. 
It seemed only fair to offer the leader a chance to review his own per- 
formance before calling for a critique from his subordinates. In turn they 
were asked their opinions of the leader’s handling of the problem. By their 
comments they revealed not only their assessment of the leader, their respect 
for him and confidence in him if they felt he merited such trust, but also 
their own intelligence, or lack of it, in the proposals they now made for 
other ways of performing the task. 

By the time the problem and the critique of it had been completed, the 
staff members were ready to rate the subordinates in the group on the 
variables of Energy and Initiative, Effective Intelligence, and Social Rela- 
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tions, and, in addition to these trails, to rate the leader on the variable of 
Leadership. 

SENTRY. — The group was then led to a hedge of boxwood on the side of an 
open field where another member of the group was instructed as follows; 

Al, you’re the leader in this situation. You have all just gathered at this 
rendezvous point after completing an intelligence mission to an enemy airfield, 
and you are still in enemy-occupied territory. Unfortunately, Gus has just 
broken both legs in a fall down a ravine and from this point on will have to 
be carried on this stretcher (points to one on the ground), A plane will make 
a point contact with you at a secret airfield in that direction (points across road)^ 
so that you have only lo minutes to get across. It is going to land and take off 
right away. In getting there, you must pass this road, which is patrolled by the 
enemy. You can sec a sentry from here. The boundaries of the problem are 
about 10 yards beyond that bush and lo yards beyond that fence (points). So 
Ear you have been able to operate in this territory without the enemy suspecting 
your presence and that’s important for future operations. One more thing — as 
long as you are standing behind this path [40 feet from the road], you may 
consider yourself under complete cover. From here on the terrain is as you see 
it, O.K., go ahead. 

The role of the sentry in this problem was played by a member of the 
junior staff carrying a rifle. His beat was laid out in such a way that he was 
actually unable to see a part of the road for about 45 seconds of each of his 
tours, and he was instructed not to detect the candidates unless it was un- 
avoidable, but to act as if he were suspicious from time to time, 

As soon as the instructions had been given, the members of the staff 
observing the proceedings made themselves as inconspicuous as possible so 
that the verisimilitude of the situation would not be lessened by their obvious 
presence in front of the sentry. The leader would then discuss the situation 
with his men, calling for their plans or outlining his own, and sending out 
scouts or reconnoitering himself. If the group were an alert and intelligent 
one, someone would note the orderly character of the sentry’s beat and call 
attention to the fact that at regular intervals the road could be crossed 
without detection. Often this fact was not noted and even at times when 
it was observed no use was made of it. Instead, the leader might order one 
of his men to distract the sentry while the group, at another point, attempted 
to cross the road unobserved; or he might direct that the sentry be killed. 

The discussion of the proposed methods of solution provided a good 
opportunity to observe the leader’s organization of ideas into a final plan, 
and in. his execution of it the staff could observe his forcefulness, his skill 
in evoking cooperation and in directing the actions of his men. This prob- 
lem usually afforded insight into certain aspects of leadership not brought 
out in the first situation, for while the Mined Road problem required close 
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direction of a group of men in a relatively simple construction task, the 
Sentry problem made more demands upon the leader’s ability to handle a 
fairly complex operation where the men were spread out in space and 
where some of them had to work relatively independently. Here the leader 
was expected to select his men carefully and to brief them adequately for 
the different jobs, such as reconnoitering, carrying the stretcher, attacking 
the sentry. He had to devise some system of communication with his men 
by messengers or signals and in such a manner that they would not give 
away their presence to the sentry. The good leader had to be open-minded 
enough to listen to the counterplans of his subordinates, yet confident 
enough of his own judgment not to be led astray by the impulsiveness which 
this situation seemed to bring out, He had to be firm in his adherence 
to his directive, which demanded crossing the road by all of the men at 
the opportune moment without being discovered by the enemy, and with- 
out leaving traces behind (such as the body of the sentry or a missing 
sentry). 

In a similar way, the problem enabled the staff to observe the subordinates 
faced with a type of situation different from the first one. Here the followers 
had greater freedom of action and more individual responsibility, Since 
they were not always directly under the supervision of ihc leader, the suc- 
cess of the operation depended more upon their ability to remember their 
Instructions and yet to act in accordance with the spirit of them on their 
own initiative, as the situation changed. Some displayed a healthy capacity 
for sound individual action; others were content to do nothing until specifi- 
cally directed. 

Many of the points were brought to light in the critique that followed 
the completion of the task. Here the leader could explain to the staff that 
he had not intended that his men should kill the sentry, or that his decision 
not to kill him had come at the last minute. Likewise the candidates in their 
criticism of the leader would reveal to the staff which of them felt impelled 
to kill the sentry in disobedience of the leader, which ones could obey the 
leader even though they were convinced he was wrong, which ones thought 
the situation would have been better if they had had closer supervision, 
and which ones, on the other hand, preferred more individual action, 

Here, as in all situations of Assigned Leadership, candidates were rated 
on Energy and Initiative, Effective Intelligence, and Social Relations, either 
as subordinates carrying out the orders of a superior or as a leader directing 
a group of men in meeting an emergency situation. In addition, the leader 
was rated on Leadership, 

agent’s room. — The instructions for this situation were given at the en- 
trance of a large, unused carriage house on the second floor of which was a 
crude living room* 
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Harey, you’re the leader here. This problem takes place in German-occupied 
France before D day in Europe. You have just received a radio message from 
headquarters saying that a friendly agent who was living in this room made 
a hurried getaway and was forced to leave some important papers behind; 
it is up to you and your men to recover these papers, if possible. You and your 
men have been passing as natives, for you have forged credentials, you are 
dressed in native costume, and speak the native tongue. Headquarters wants a 
report by radio within ten minutes. 

With nothing more than this to guide him the leader had to make his 
plans, scout the terrain, and organize a warning system against surprise by 
the Germans. Some leaders were extremely cautious in their approach to 
the room, fearing a trap. Others, heedless of possible enemy intrusion, led 
all of their men upstairs in a concerted effort to search the room. Usually, 
however, the leader and one or two men would make their way to the 
room in a circumspect manner while the others took inconspicuous posi- 
tions as lookouts, prepared with a system of signals to warn of enemy 
approach. In any case, shortly after the candidates began to search the room, 
a junior staff member, armed with a rifle and identified as a German guard, 
approached the carriage house, and if not delayed by the lookouts, proceeded 
upstairs and belligerently demanded an explanation of the men's presence 
there. 

In addition to gaining, as usual, an impression of the leader's ability to 
plan and carry out a critical task and the subordinates' capacity to cooperate 
and follow their leader effectively, the stall had the opportunity to observe 
how the leader and his men reacted to sudden threat, and how ingenious 
and resourceful they could be in meeting it. Observing the Icaclcr^s method 
of approach, the stafl could learn how impulsive or how cautious he was; 
how well he could distribute his men in a situation that demanded, on the 
one hand, speed and thoroughness in searching the room, and, on the other, 
caution and completeness in guarding against detection by the enemy. Here 
again was a situation which did not permit the leader to supervise each 
man directly from beginning to end. Special note was taken of the leader's 
reaction when he discovered that an enemy soldier was approaching, 
whether he was calm or upset in the face of the emergency, and how ef- 
fectively he could cope with the intruder and still accomplish his prime 
mission of gaining possession of the important papers. Some leaders forgot 
the aim of the undertaking and sought only to effect the escape of their 
men; others sought personal safety or led a retreat in rout; some tried to 
overpower the guard and continue the search; still others attempted to 
depend on their cover and talk their way out of the predicament on the 
strength of their forged credentials and native dress. 

Of course much of what the leader did in this situation was often the 
result of the ideas and behavior of his men, for the subordinates had con- 
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siderable opportunity for independence of action. For example, when the 
German soldier appeared, some lookouts would give the warning signals 
immediately while others would wait until the soldier was on the stairs. 
Some would attempt to kill the guard, others would try to delay him by 
making conversation, asking advice, or inventing some emergency. Still 
others would simply do nothing and avoid the guard and even hide from 
him. Light was shed upon the Energy and Initiative, and Effective Intel- 
ligence of the subordinates, and on the men’s capacities for calm individual 
action in keeping with the spirit of the leader’s orders. 

In the critique the leader again had an opportunity to evaluate his own. 
performance first and say how he might have handled the situation differ- 
ently or why he would do it the same way again if he had another chance. 
The followers could then explain their behavior and offer alternative solu- 
tions, as well as criticize how the leader had handled the problem. 

BLOWN BRIDGE. — Tliis situation had some resemblance to the Mined Road 
since it, too, was a problem of construction. For this test there had been 
erected, in an open field, two abutments three feet high and, in die inter- 
vening twenty-five feet, five posts were set up which formed an X pattern 
(as on the five of spades) which rose vertically five feet out of the ground. 
On the side where the group stood a number of boards were strewn 
around. One might think that these could be used to make a bridge from 
one abutment to the other over the pilings, but actually there were not 
enough boards of sulficient length to permit the building of a single, con- 
tinuous bridge. The instructions for this situation were: 

Bim, you’re the leader in this one. You and your men are returning from a mis- 
sion of sabotage. You arrive at this bridge, which you had planned to use in 
crossing this stream, and find that it is demolished. The stream is a raging 
torrent at the bottom of a rocky gorge and is impassable except by bridge. 
(Points to limits of stream,) It flows between the abutments, running this way, 
There is nothing left of the bridge but the abutments and pilings as you see 
them and this debris, There are no other bridges you can use in getting across. 
Enemy patrols come through here along the stream roughly every seven minutes. 
We’ll give you a minute or two to talk dils over and when you are ready to 
go, you can assume that a patrol has just passed. O.K., go ahead. 

As in other assignments, the brief period of discussion provided the staff 
members with a chance to see whether the leader could size up the whole 
situation and to what extent he was capable of organizing the ideas of his 
men into an effective plan of action. Similarly once the work began, they 
could observe the leader’s ability to direct his men without relinquishing 
the lead to a more energetic or intelligent teammate and his competence in 
coordinating the efforts of his men toward the common goal. 

The problem of the Blown Bridge made certain special demands upon 
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the leader’s ability to maintain control, since the first man to get out on 
the pilings was in an excellent position to take over the direction of the 
work. This man could see the chief problems involved in arranging the 
boards properly according to size in spanning the pilings. He, better^ than 
anyone else, could discover the fact that only one board would bridge both 
the span from the near abutment to the first piling and the span from the 
last piling to the far abutment. If the candidate who happened to be first 
out on the pilings was a man of initiative, as he very often was, he might 
be inclined to take charge of things from then on. The reactions of leaders 
to this threat varied; some immediately accepted the role of subordinate and 
followed orders just as if they had not heen appointed leaders; others 
realized the other man’s vantage point and allowed him to play the role of 
the good lieutenant, without relinquishing control of the group; others 
tried to put through their own ideas, ignoring much of tire valuable infor- 
mation coming from out front. In some cases, of course, the leader was 

the first one out on the pilings and consequently this conflict never arose 
tor him. 

At about the time the seven minutes were up, or just before the men had 
worked their way across the pilings, a stall member would inform diem 
chat the enemy patrol could be beard approaching not far off. Shortly 
thereafter, on a prearranged signal, a stooge concealed behind a near-by 
wall would open fire on the group with blank cartridges. The reaction of 
most leaders to thc_ first warning was merely to urge their men to hurry, 
bu many ipored it. When the actual firing began, some leaders would 
ca feverishly for greater haste in pursuing the initial plan; others would 
c ange their plan to the extent of having the men jump from the last 
piing to the bank, a difficult feat; some would order their men to take 
cover behind the pilings and sit tight; others would tell them to jump into 
the river and swim for it, despite the fact that it was a "raging torrent"- 

•nd „.ll .„„obili„d by ,h. would iL ooZoi; 

personal safety, would leave the rest to 
in the near-by 

moo » d“ 

The information gained about the subordinates at the Blown Bridec was 

env! approached and opened fire. Here, if die leader 

fnto “ “="nt jumping 

seek saLr ^fh “‘i^^rs ^uid choose to ignore his authority ^and 

y in their own way. Still others were too confused to decide on 
any consistent course of action. 

Here the staff gained a more or less definite impression of the effective- 
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aess of the leader, particularly the extent to which he could evoke immedi- 
ate respect and obedience in a crisis, and knowledge of the degree to which 
other members of the group were able to function as intelligent, energetic, 
agreeable, and resourceful subordinates. Given the opportunity to discuss 
their performance, some leaders sought to explain away their shortcomings 
by saying that the man first out on the pilings had assumed too much 
authority, or that it was every man for himself in this emergency, or that 
their predicament was hopeless once the patrol had spotted them. 

KILLING THE MAYOR, — As soon as the fourth outdoor situation was over, 
the candidates were assembled in the classroom around a large sand-table 
model of a town and its surroundings. Pointing to a clearing in the woods 
In the extreme northwest ‘corner of the sand table, the examiner told the 
assigned leader that he and his men had just jumped in on a special mission 
to German-occupied France. Their orders were simply to kill the mayor of 
the town who lived in a house on the outskirts of the village about three 
miles as the crow flics from where they had landed. They were told that 
they had parachuted from the plane at twelve midnight and that the plane 
would land at the same place twenty-four hours later, at twelve midnight 
of the next evening, to make a spot contact and pick them up. The staff 
member then informed them that they could all speak the native tongue, 
wore native clothes, and had forged credentials so that they could readily 
pass for natives of the region; furthermore, they could assume that they 
had all the light equipment necessary for this mission, such as knives, 
ropes, sidcarms, small quantities of demolitions. The sand table could be 
used as a map in planning the mission, but once the work got under way, 
they were to behave just as though they were walking through the actual 
terrain. 

Then the candidates were informed that they had just hit the ground 
and the mission had begun; the examiner would at intervals announce the 
passage of time. After the discussion had continued for a few minutes the 
staff member would interrupt to say that it had taken them some time to 
gather up their equipment and find cover after landing, and that it was now 
12:30. If the talk went on, in another minute or so the examiner would say 
that it was 12:45. Ordinarily, the discussion would consist of talking over 
plans for getting into town undetected, arranging signals and rendezvous 
points, planning reconnaissance of the area around the mayor’s house, de- 
ciding on the best way to kill him, and so forth. Some leaders failed to 
adjust to the pressure of time and carried on the discussion until three 
or four o’clock was announced, even though they had originally planned to 
kill the mayor before dawn. Others decided to wait out the night in the 
woods, reconnoiter the town the next day, and carry out the mission the 
following evening. 
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Just before the group was ready to leave its landing place the staff mem- 
ber would announce the first emergency problem: the leader had sud- 
denly become aware of a stranger, ten feet away, looking at them all in- 
tently; he was dressed in hunting clothes and carrying a gun. The examiner 
would say that he would play the part of the hunter, and then he would 
ask, “What are you doing here?” Some leaders impulsively decided to kill 
the man on the spot; others to knock him down, bind, and gag him; others 
attempted to talk their way out of the situation by using the advantages 
of their cover; still others started to interrogate him on points pertinent to 
their undertaking. When questioned, the hunter would be vague about his 
loyalties and his knowledge of conditions in town; if pressed, he would 
reveal that there was a garrison of Germans in the town but he did not 
know how many troops there were. Eventually, the leader would have to 
decide what to do with the hunter; either kill him, tie him up, place 
him under guard, or let him go, hoping that he would not report them. 

At the agreed-upon time, the men would set out for town, singly, in small 
groups, or in a body, deseribing their routes at the request of the staff 
member. By means of introducing incidents such as arrests, hearing impor- 
tant information from the residents, or being questioned hy guards, the 
staff member could test the candidates’ reactions to emergencies and, by 
controlling the passage of time, he could regulate their movements accord- 
ing to the way he wanted the problem to develop. Usually, however, the 
main emergency situations were presented to the leader. For example, if 
the men were attempting to cross the river by means of the highway bridge, 
the staff member could tell them that, as they approached, they noticed that 
the guards were questioning everyone and turning back some, letting 
others through, and detaining still others. The leader might decide to 
attempt to get by the guards anyway, in which case he might he turned 
back or let through. Or the leader might decide to try to cross the railroad 
bridge, or to ford or to swim the stream. In any case the staff would gain 
some indication of the candidate’s resourcefulness and judgment, his tend- 
ency to be impulsive or cautious in an emergency, and his ability to con- 
trol men who offer unwise suggestions. 

Some leaders developed the simple plan of going directly to the mayor’s 
house, expecting to find him in. If it suited the staff member, the mayor 
would be at horne; otherwise, he would be out. In the latter ca.se, the staff 
rnember might have the men overhear someone say that the mayor was 

nl? nVh /V be home the 

nm night. Other leaders developed more comprehensive plans which in- 

tiroM ^ whole region, collecting information or even, at 

times setting incendiaries with a time fuse in a barn at the opposite end 

Orh^ to distract the population at the hour set for the murder, 

Others seriously complicated their main plan by seeking to accomplish 
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other purposes: they might send out men to blow up the railroad tunnel 
or the bridges. Thus, in most cases, the situation permitted assessment o£ 
the leader’s purposefulness, of his ability to plan simply and effectively, and 
of his foresight and sense of responsibility for his mission and his men. 

By the simple expedient of having the leader arrested as the group was 
leaving the vicinity of the mayor’s house, it could be arranged to have an- 
other man take the group back to the rendezvous with the plane. The 
candidates were merely told that while escaping they noticed that some 
German soldiers stopped the leader and then immediately led him off under 
guard; the remainder of the men were unnoticed and, shortly after the 
incident, got together and elected the now-designated man as their new 
leader. 

The situation at the time of this change presented the new leader with a 
question that required an immediate answer; should the group attempt 
to rescue the original leader? Some men passed over this problem and 
proceeded to the rendezvous point. Others debated the point with their 
men and abandoned the idea. Still others felt impelled to attempt the 
rescue, ignoring for the moment the necessity of getting back to meet the 
plane. The way in which this dilemma was resolved gave the stviff some 
insight into the judgment of the new leader, his discretion, his loyalty to his 
men, his sense of responsibility for the mission. 

When the time came for the return of the group to the rendezvous the 
leader had to plan this maneuver and execute it in the face of incidents and 
accidents created by the staff member in such a manner as to interfere with 
the carrying out of the initial plan. As the men were finally making their 
way through the woods to the rendezvous at 11:30 p,m., the examiner 
would inform them that they had almost walked into a large German 
patrol which was feverishly searching the area and, overhearing the talk 
of the soldiers, they had learned that the hunter whom they had encountered 
the first night was the instigator of the search. The hunter had been a 
collaborationist; if they had killed or detained him, the fact that he was 
missing in that area had led to the search; if they had released him, he had 
reported to the Gestapo. Anyhow, the patrol was covering the area between 
the candidates and their rendezvous point and time was passing; it was now 
11:40. In meeting this predicament, some leaders urged that they retreat 
and attempt a more circuitous route; others decided to wait and see what 
would develop; others attempted to infiltrate the area under cover; others 
decided to fight their way through. By 11:55 it was conceded by the staff 
member that the group had made its way to the rendezvous point success- 
fully but that the patrol was still searching the area only a short distance 
away. The leader was told that they could now hear the motors of the 
plane that was coming to pick them up; and, if he did not realize it him- 
self, he was told that it was certain that the Germans could hear the plane 
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too. At this point some proposed that they seek to warn the plane away 
by flares or gunfire, and then if possible hide from the patrol; others would 
let the plane land and take the chance of boarding it successfully despite 
the proximity of the Germans; others decided they would fight the enemy 
off until the plane landed and try to make a getaway; still others thought 
of some ruse such as dispatching one man several hundred yards away 
to set off an explosive or incendiary charge to distract the Germans; others 
thought only of escaping from the patrol without even warning the pilot 
of the plane. 

Usually the problem ended with the candidates discussing whether or 
not they actually could have made their getaway. Using this as a point of 
departure, the examiner would start the critique, with other members of 
the staff joining in from time to time. The original leader might be asked 
why he had treated the hunter as he had, and the others encouraged to say 
how they would have handled this problem. Often it was impossible to say 
whether one decision was better than another; what revealed both the intel- 
ligence and the planning ability of a leader were the reasons he offered for 
each decision he had made. 

For the success of this assignment, the skill with which the examiner 
conducted it was crucial. It was he who kept it alive and exciting or let 
it become flat through lack of imagination in creating emergencies and 
unexpected incidents. Yet his role could not be too dominant, for if it were, 
the distinctive traits of personality of the candidates would be obscured. His 
job primarily was to make the candidates face the more-or-less standard 
emergency situations that were designed to arise in the course of carrying 
out the problem:_for the first leader, handling the hunter, killing the mayor, 
and perhaps getting by the sentries; for the second leader, taking over the 
responsibility of a mission without warning, deciding about rescuing the first 
leader, getting past the patrol, and deciding what to do about the landing 
of the plane. In addition, the examiner had to keep the problem going by 
putting the leaders under pressure, by announcing the passage of time 
every so often, and by delaying the men with minor incidents in case they 
went too fast. Despite the fact that the mission was always the same in this 
problem, every time it was run the proceedings developed somewhat' differ- 
ently. No matter what special turn a group of candidates gave to the assign- 
ment, It always worked out as a test of planning ability and skill in meeting 
new emergencies. It gave the staff insight into how a man went about plan- 
ning and handling such an operation : the freedom he allowed his men, the 
methods he designed to maintain control, his capacity for detail, his 
foresight, his adaptability, the rigidity with which he adhered to his original 
plan in the face of emergencies and changed conditions, the extent to which 
he discussed problems with his subordinates, his capacity for quick and 
independent decision, his sense of responsibility to his men and the mission, 
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his decisiveness. In respect to the subordinates, the staff could rate their 
energy and Initiative, Effective Intelligence, and Social Relations, and gain in- 
sight into their ability to cooperate in the planning and execution of a mis- 
sion. The situation also permitted appraisal of their reaction to emergencies, 
their capacity to help make decisions, their judgment, responsibility, and 
resourcefulness. 

Teaching Test, — During the course of the morning the leaching abilities 
of candidates slated for assignment in the OSS schools were tested. These 
men had been forewarned and given an opportunity to prepare themselves 
for this on the previous evening. The procedure was conducted in the 
classroom, where the candidate had the use of a blackboard and any other 
materials which he requested, provided wc were able to furnish them. His 
awareness of and desire for such teaching aids, as well as his use of them, 
were noted in our estimation of his teaching ability. 

The candidate had as students a group of three to six staff members who 
supposedly knew nothing of the subject of his talk, but who were later to 
teach it to others. He was allowed fifteen minutes, which was ample time 
in which to present his material if he had planned it well. 

Whenever possible, observers who were not familiar with the subject of 
the candidate’s talk were included in the “class” to report on the efficacy 
of the instruction. Each candidate’s performance was evaluated in terms of 
the specific teaching assignment for which he was being considered. 
Neither his over-all performance nor any aspects of it were rated on our 
six-point scale. The appraisal was qualitative, taking into account the can- 
didate’s understanding of his material, his organization of it, his efforts 
and success in maintaining the interest of the class, and the effectiveness 
of his presentation. The ease with which the candidate spoke, as well as any 
signs of nervous tension in this difficult situation, was considered in relation 
to the man’s previous teaching experience or lack of it. 

Terrain Test. — The last forty-five minutes of the morning, after all 
subgroups had participated in the Assigned Leadership problems, were de- 
voted to the Terrain Test which required candidates (i) to answer thirty 
multiple-choice questions concerning the physical aspects of the farm on 
which S was located, and (2) to write as fully as possible concerning the 
activities which in the past had been carried on there, the people who at one 
time or another had been connected with it, the interests of its owners, and 
any other significant facts relating to its past history. Scores on this test were 
converted into ratings to yield another measure of the ability of candidates 
to observe, infer, and report. 

Names and Identifications — ^The first test of the afternoon, a conven- 
tional test of memory, was given in a most unconventional manner. It was 
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designed to test the ability to associate names and identifications with faces 

subsequent presentation of the faces alone 
This ability is important in many types of work, but it takes on special sia^ 
nincance in the gathering of intelligence. * 

Two sets of twelve slides were prepared for this test. Each slide of the 
first (or learning) set had on it the photograph of a man, his name (pseu- 
donym), age, occupation, and city and state of residence. The second Cor 
testing) set had only the photographs. The first set of slides was showinn 
groups of four, each slide being exposed for twenty seconds. After cadi 
group of four had been presented, the corresponding slides of the second 
set were shown for thirty seconds each, in random order. Tlie task of the 
canjdates was to record during the exposure of a slide of the second set all 
of the data that had been printed on the correspnding slide of the first set 
In the scoring of this test credit was given for each item recalled, 

The member of the staff who had acted as interrogator in the Stress In 

witty pon. This performance of his, ttniqtte ill the Sr, 

m tins way served to dispel whatever resentment against him mieht Inve 
been hanging over from the preceding evening. It would have run against 

f member-who contributed so much fo the 

high morale of the candidates at S-to administer any test in accoXnerwith 

h re the verve and torrent of his inimitable discourse ^ 

bv ^e shocked that instructions embellished 

y barrage of farcical comments should have been allowed to nrecede a 
est of memory, ir shoold be here recorded .hat ,he odSn elhb o 

SITS '”p“ “““ •‘■-“f' =-33. wa“ ^ 

rected by the Spearman-Brown formula to .88. 

candid7?s w!7Th7wnT7o observing and reporting, the 

about two and one half minutes. They were'inTtmcted'm 

were agents in tlip fipld ,„i i j r ^ instructed to assume that they 

who would be identified f^r them'^^'l p trailing two men 

They were to d To 7 , T T ^he screen. 

report everythmj theyS^S tel mSdo*'™'™ S'"' “ 

mentrab^ut thra^fion ^epicS^ fiT*" state- 

Pinion who he^revt T;.;ey\.Tee7K^ T"'“ 

which of the reported nhsprvrii-i'eo ^ ^ task was to indicate 

"tliVd “ inlc7rtS7uncelinty'^ “ 

Caodtdatea were allowed ten mi.otea for checking ealh act of atatemeott. 
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The scoring formula for the test was the number right minus one half the 
number wrong. 

These two testSj Names and Identifications and Movie Observation, which 
yielded ratings of the ability to observe and to report, were given to all re- 
cruits. After completing them, the candidates who had been recruited for 
intelligence work in the field were given a test of aptitude to learn Morse 
code. 

Code Aptitude Test.^— The test employed for this purpose was the Signal 
Corps Code Aptitude Test (standard in 1943), which is automatically ad- 
ministered by phonograph records giving the instructions, sample problems, 
and seventy-eight pairs of patterns of code sounds for each of which it is 
the task of the subject to decide whether the patterns of sound are the same 
or different. Army norms were used in interpreting the scores obtained by 
the subjects. 

Interrogation Test (Escaped Prisoner).— After he had completed the 
group written tests of this afternoon and before he reported to run the Ob- 
stacle Course, each man who had received Instructions for the Interrogation 
Test on the previous evening went individually, each at an appointed time, 
to the third floor. There he was taken into a moderately large room and in- 
troduced to ‘T/Sgt Smith** (a member of the junior staff). While Smith 
and the candidate seated themselves at opposite sides of a desk, the staff 
member conducting the test withdrew into the background, slightly behind 
the candidate, to observe the interview and to make a record of its content 
by checking the topics covered on a check list, 

T/Sgt Smith had a fixed story, which is indicated by the Information on 
the check list reproduced on pages 162-163. played a definite role, answer- 
ing questions with relevant information, but volunteering no additional 
data. Once or twice during the interrogation, he would drop a hint of other 
facts in order that the alertness of the interviewer might be observed. 

At the end of twelve minutes the candidate was conducted to another 
room and instructed to write a report of his findings. Immediately after the 
interview the staff member who had acted as observer and the one who had 
played the role of T/Sgt Smith made independent ratings of the candidate’s 
skills in developing rapport, in asking productive questions, and in follow- 
ing up leads and hints. From these two scores, together with a rating on the 
completeness and the organization of the candidate’s written report and a 
rating on his performance based on the check list, a single, final grade was 
derived. Although this rating procedure was not fully standardized before 
V-J day, the score and the qualitative observations made during Interroga- 
tion were used in determining the final rating of the variable known as Ob- 
serving and Reporting. 
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CHECK LIST FOR INTERROGATION TEST 

Students’ Names 















SMITH'S UNIT. ' ■ 







LOCATION OF THE CAMP WHERE SMITH WAS 
incarcerated (io mi. S. of Wuchang). 
i->on t know location of the camp. 

Bomber was headed from Kweisien airfield to bomb Jap- 
held airbase at Hangchow to east. ^ 

in air only 20-30 minutes when pilot said elevators 
weren t working at all. Brace selves for crash land- 
ing, Couldn’t climb above bad weather. 

Unconscious. Regained consciousness on' being loaded 
into back of truck. 

Rode about two hours before arrival at prison camp. 
Could hear trains m west or north of prison camp. 
Think I traveled in southwesterly direction on «cape 
rom camp. May have been south, may have been 
west. Escaped at night. Traveled 2 days through woods. 

1 Crossed no railroad. ° 

Crossed no river until, with party, the Wuking near 
Chaolu was reached. 

Came through no cities. 

Crossed no main highways, 

Fairly level ground, wooded. 

Airfield under construction— level, wooded. 

(Also credit suggestion to check Kweisien airbase to 
find what area had been bombed on day of rescue.) 







treatment of prisoners. 

Food: Most of prisoners very poorly fed. 

(In respon.se to request for more clarification.)' About 
600 of healthiest men fed a little better. More bread. 

1 n further questioning, gives evidence of airfield 
preparation— steamrollers, etc., seen.) 

^ S’*. morning, 

with_ tea sometimes. Thin soup and bread at 

evening. Sometimes horsemeat once a week. Just 

a bite. Soup thick when Red Cross visited. 

■Lost 15 pounds. 
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Clothing: Some articles provided in March when Ecd 
Cross worker appeared, 

SiiiiLTKR: Two huge flimsy shelter houses, -300' X 200'. 

No heat, Licc-infcstcd straw and thin blankets. 
Wouk: About 10 hours a day for those not too weak- 
ened by malnutrition to stand up long. Digging post- 
holes, cleaning latrines, making long clearing in ad- 
jacent ground, digging graves. 

Punishment: Many rules. Violations often brought flog- 
ging to individuals, further restricted diet to whole 
group. 

(See any prisoners killed outright?) Saw one resting 
worker bayoneted. 

Medical Care: If couldn’t walk. 

Interrogation: Interrogated but no force used. 

Mail: Some got mail. 


1 





SIZE OF CAMP, 

Size and Shape: 10 acres — 400 X 1000 ft. 

Personnel: Four shifts at meals— 500 at my shift. 
Expanding: (i) 500 moved into adjacent shelter house 
just after “arrival, 

(2) Lieutenant Colonel , an engineer, re- 
placed a captain in charge. 

Number op Guards: About 100. Second-rate troops. 
Composition: Chinese in one house and Americans in 
other. 

Americans — 100 14th Air Force personnel. Rest — 49th 
division. Officers and men thrown together. 







OTHER INTELLIGENCE ASKED FOR. 

1. Cause of crash landing, 

Probably elevator blocks not removed. 

2. What happened to rest of crew? 

Told that 4 died in crash, 4 shot resisting capture, 

3. What did you see on way back from camp? 

Saw small party of Japs a couple of hours before 
the Chinese picked me up. 

4. Damage by air raid, 

Only a couple of bombs were dropped, Many in- 
jured, however. 

5. Number escaping at same time as Smith. 

A few, but they took separate routes. 

6. Morale of guards. 


Officers strict* 

Men somewhat indifferent. 
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Obstacle Course.— The latter half of this afternoon was given over to 
running an obstacle course designed to test the candidate’s physical agility 
and daring. Although the course yielded some indication of physical condi- 
tion, it could not be regarded as a measure of capacity for endurance. That 
could have been tested adequately only after the candidates had undergone 
a period of physical conditioning. However, the willingness of a man to 
make an effort, that is to say, his motivation, could be rated fairly accurately. 
It was too much to expect that all candidates whom we had passed at S 
would be in top condition in the field when (possibly after months of rela- 
tive inactivity) they might be called upon to exert themselves to the limit in 
carrying out a mission, or in escaping the enemy. It seemed to us important, 
then, to estimate how much effort a man was willing to make in an obstacle 
course even though he was not in the pink of condition. At the same time 
we had to be on the alert for those cxhlbicionistic candidates who might 
willingly “knock themselves out” before the audience at S but who might 
fail to expend themselves in an emergency in the field. 

Several obstacle courses were built and used during tire history of S. An 
early course which traversed a large part of the farm and which required 
quick resourcefulness in emergencies, in addition to agility, daring, and en- 
durance, was eventually abandoned because it was too Cimc-coassuming both 
for the staff and for the candidates. In its place the staff developed a more 
efficient course which measured only physical agility and daring, no attempt 
being made here to test resourcefulness and fitness for emergencies. During 
the last months of S, the Obstacle Course which was used combined parts 
of two separate courses. Any man under forty-five or fifty who had not al- 
lowed himself to become soft and who had taken reasonable care of his 
weight was allowed to run the course. It was our practice, however, to set 
forty years as the upper limit unless a candidate over that age expressed a 
strong desire to participate. None of the obstacles was either extremely 
difficult or extremely dangerous, though some appeared to be. Further, they 
did not test any special skills; they were constructed on the assumption that 
every man has had some experience as a boy, swinging on rings, climbing 
walls, fences, and ropes. 

The first part of the course was so constructed that a candidate could 
select obstacles of greater or lesser difficulty. A man’s score on a given ob- 
stacle was, therefore, a function of the difficulty of the obstacle he selected 
and the skill with which he overcame it. The course was set out so that each 
member of the staff could observe the performances of all the candidates for 
whom he was particularly responsible, He was thus in a position to obtain 
impressions of subtle, unscorable components of behavior which have special 
significances for one who has already arrived at a partial conception of a 
personality. For example, does the candidate give up easily on a difficult 
obstacle to select an easier one? Does his interest lag with failure? Does he 
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meet each obstacle with a determination and a persisting drive to overcome 
it? Is he quick to evaluate and size up a situation? If he refuses one of the 
tests of daring, how does he rationalize his decision? The bits of behavior 
which shed light on these questions could not be given a score and by them- 
selves could not serve as bases for generalizations about traits of personality. 

If they had already been observed in other test situations, however, they 
now acquired significance in the diagnosis of the man’s personality* Since 
each of the several obstacles had characteristics devised to sample slightly 
different aspects of performance, each is described briefly and in the order 
that the candidate encountered it on the course. The candidates were given 
a written description of the course, and started on their way at five-minute 
intervals. 

The first obstacle presented two alternatives, one requiring daring and 
considerable agility, the other demanding little of either. The former con- 
sisted of a set of four rings attached to separate ropes which in turn were 
suspended from a rope stretched between two large maple trees that were 
about 50 feet apart. The rings were about 12 feet from the ground when 
hanging freely, but sagged with the weight of a man to approximately 9 
feet, The candidate’s task was to climb to a platform nailed to a branch of 
the first tree, about 15 feet above the ground, and, with the first ring in hand, 
to swing off, and, on the upward arc of the swing, to grab the second ring, 
and then by swinging from ring to ring, to bring himself up finally into a 
large crotch of the second tree. The task was a difficult one to complete; only 
about 5 per cent of candidates were able to cross all the way from one tree 
to the other. The ease with which a candidate executed his swings was a 
good measure of his agility. The way in which he approached the problem 
was an even better measure of his daring. The obstacle was not very dan- 
gerous, though it appeared so. Many men, to be sure, lost their grip on the 
rings but, because of the sag in the rope, fell no more than two or three feet. 
But the platform looked very high as seen from the ground and once a man 
had reached it the apparent distance to the ground was such as to make the 
initial swing a real test of daring. Some paratroopers reported to us that it 
was fully as difficult for them to swing off the platform in this test as to step 
out of the door of a plane. 

A man who was unwilling to attempt the rings could choose the. alterna- 
tive obstacle: a rope stretched horizontally between two trees 20 feet apart 
on which a man could cross hand over hand, The rope was about 10 feet off 
the ground. Once across the candidate could lower himself on a rope which 
hung vertically from the second tree. 

The second obstacle presented the candidate with three alternatives and 
was primarily a measure of agility, although it provided in addition a meas- 
ure of a man’s confidence in his own ability. The task was to get over a 
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hedge by going up a wide board inclined at a angle from the ground 
and down the other side on a board placed at a corresponding angle, the 
two wooden planes forming a sort of pup tent bridging the hedge. There 
were three such structures of different degrees of difficulty whose sides 
measured 6, 8, and 9 feet, respectively. Here, as also in the nc.xt part of the 
course, a candidate who failed an obstacle was permitted to try an easier one 
if he so desired; and he was allowed as many attempts as he wished to get 
over any chosen obstacle. ° 

The third obstacle was a smooth wall 24 feet long built in three sections, 
8, 10, and 12 feet high. On the face of it were cleats providing few and 
uncertain footholds. The candidate was judged by the height of the wall 
which he attempted to climb and the strength, agility, and persistence of 
his efforts. 

Having scaled the top, or failing that, having been allowed to climb to 
die top by means of steps provided for this purpose, the camlidatc found 
himself facing the fourth obstacle: two catwalks, one in feet and the other 
8 feet above the ground, leading off at right angles from the wall. These 
catwalks extended for 20 feet over a sawdust pit. On the far end of each 
walk a narrow ramp led down to the ground, The instructions to the can- 
didate were to cross on either walk he chose in any manner he wished— 
walking, crawling, sliding, but not running. He would receive more credits 
if he chose the higher one and more credits for walking than for crawling 
or sliding. Both walks were 3J4 inches wide. They looked firm, but actually, 
since they were not supported in the middle, they oscillated sideways to an 
alarming extent as soon as anyone stepped out on them. It required rare 
balance and skill to get across either catwalk without falling off. This was 
a test of both daring and agility. 

When all candidates had finished these obstacleSj they were taken as a 
group to the second part of the test, which was an adaptation for our pur- 
poses of the Army’s Running Time Course. The course, which was laid out 
around the sides of a large square field, consisted of twelve identical pairs 
of obstacles, three pairs on each side of the field, thus making a two-lane 
course. The obstacles were placed about 15 feet apart except at the corners, 
w ere there were stakes instead of obstacles. From the starting line, which 
was on. slightly higher ground 'than the rest of the course, the staff could 
observe the candidates on every obstacle. 

^ In order to heighten motivation two candidates ran the course in compe- 
tition. Each man’s score was based upon his total time and his success in 
negotiating the obstacles. If a man failed an obstacle he was made to try it 
a second time. After that, regardless of the outcome, the rules were that he 

was to go on to the next obstacle. Each man was also rated on motivation, 
agility, and stamina. 
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The obstacles of the Running Time Course, in the order in which they 
were encountered, were as follows: 

1) Three low hurdles of increasing height, spaced about 4 feet apart, 

2) Three firmly braced high hurdles, all about 5 feet high, which had to be 
vaulted with the use of hands and legs. 

3) Parallel bars about 5 feet long. 

4) A cobweb obstacle which was a lo-foot stretch of irregular wire 
entanglement 18 inches off the ground. To get through the obstacle the 
candidate had to step high over the wires and find spaces between them 
through which his feet could reach the ground. 

5) An overhead horizontal bar, 12 feet long, 7 feet above the ground at 
the start and 8 feet above the ground at the end, which was to be traversed 
by the candidates hand over hand. 

6) A double row of twenty open boxes, each a foot square and 6 inches 
deep. The problem here was to run through the obstacle stepping in every 
box. 

7) Two parallel fences 10 feet long and about 2 and a half feet apart, 
from which, alternately on the right and on the left, partitions extending two 
thirds of the way to the other parallel fence were built, thus forcing 
the candidate to zigzag his way through the area between the fences. 

8) A catwalk about 3 inches wide and 3 feet off the ground which made 
four 145° turns from beginning to end, alternating from left to right. 

9) Wire mesh 2 feet wide and 25 feet long stretched 18 inches above the 
ground and forming a passage through which the candidate had to crawl 

10) A pit only 2 feet deep but 6 feet wide and filled with water to be 
jumped after the candidate had run up an incline. 

11) An 8-foot wall to be scaled. This was difficult because it came toward 
the end of the course when candidates were tired and was so placed that 
they had to run up a hill to do it. On the face of the wall were no cleats 
or grips, 

12) A pit, 2 feet deep and 8 feet wide, in crossing which the candidate 
had the use of a rope suspended from a beam over the center of the pit. 
The rope, which was just long enough to enable a man to swing safely 
to the far side of the pit, hung motionless as a candidate approached, The 
technique for executing this obstacle was to run and jump for the rope, 
swing on it and then let go the moment one’s feet touched the far bank, 
at the same moment throwing one’s body forward so as nor to fall 
back. 

To complete the course, candidates ran to the finish line. 

The exercise taxed even those who were in the best of condition. One 
distinct advantage it had over earlier courses used at S was that it required 
the use of all parts of the body, rather than placing a great premium upon 
strong arms. 
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Improvisations.— After supper on the second full clay, one of the most 
revealing of our assessment procedures was conducted. By this time, all 
candidates had been interviewed. Tlicy luul heca observed luith casually 
and in many planned situations; and tlicir performances on a variety of 
paper-and-pencil examinations— standard tests, tests of our own making, 
projective techniques, and special assignments— liad l)ccn read, scored, 
analyzed, and interpreted, By now we hud a pretty gaud idea of the kind 
of men with whom we were dealing. Despite the shortncsss of our ac- 
quaintance, some of us were beginning to feel that we understood the 
candidates better than we understood some of our old friends. Yet again 
and again it was our experience that just at this jx>int, a question as to 
the presence of some suspected tendency would arise, the answer to which 
was necessary before our conceptions of their {>crsonalitics could become 
clarified. We needed some procedure which could be used to prove or dis- 
prove these critical hunches. Ultimately wc came lo what we wanted by 
adjusting Moreno’s psychodrama to the purjK)Scs of assessment. The trick 
was to invent for each candidate appropriate dramatic situations to which 
he had to respond realistically. These we called Improvisations. 

Two sessions of Improvisations were run simultaneously from 6:30 to 
9:00. Half of the group met in the living room, the other half in the class- 
room. The props were simple: a table and two chairs at the front of the 
room; around the room otfier chairs for the audience. 

The staff member’s opening remarks, which described the procedure 
of Improvisations to the candidates, will serve also to explain it to the reader, 

Tonight we are going to have you do something a little diflercnt from the 
other things you have done here* Wc think you will enjoy it. Most other classes 
have in the past, as soon as they got the idea of what wc were doing. 

You arc going out to fill a variety of jobs in this war. In most of them it will 
be very important for you to deal effectively with other people. It will be necessary 
for you in many cases to size up others quickly and make quick decisions on tlie 
basis of your judgments. We have seen you in a number of tests and more or less 
artificial situations here, but wc have never had an opportunity to see you in 
action in real-life situations, that Is to say, in your day-to-day social and business 
dealings. We have therefore taken the liberty of making up some situations 
dealing with real life, and wc arc going to ask you to take part in them. So that 
you won’t be in an entirely strange situation and at a loss for words, we will base 
these roles on your cover stories and on the postwar plans wc collected from you 
this morning. You will be dealing therefore with things with which you are 
familiar, about which you at least know the lingo* 'Wc are going to ask you to 
comevip here two at a time to sit in these chairs and work out the problems wc 
will give you, to the best of your ability. 

Approach the problem in any way you like. If you find that you can settle 
the situation to your own satisfaction in one minute, you are free to do so. 
Usually, however, you will talk for about five minutes and then I will warn you 



169 


Assessment at S; Procedures 

that you have about one or two minutes to come to some sort of decision and 
bring the situation to a close. We are not interested in your ability as an actor. 
As a matter of fact, acting usually shows up very badly here. What wc are 
interested in is how effective you can be in the role in which you are placed. 
For instance, if you are given the part of a farmer, we don’t want to see a 
portrayal of the typical hayseed, but just yourself as you would be if you should 
happen to own a farm. We would like you to approach each situation seriously 
and try to do your best. I think you will find that there will be plenty of laughs 
without any clowning on your part and that you will be much more effective 
if you make a serious effort. 

During your stay here you have attempted to break each other^s cover. Tonight 
we are not interested in breaking cover, at least not in that sense. None of 
you believes these stories anyway by now, but we would like to get some idea of 
your ability to judge character, to break through and tell what kind of men 
you are actually dealing with here. We are going to ask you, therefore, after 
each of these short situations is over, to comment upon two things: one, the 
effectiveness of the individual in his part, not as an actor, but in his actual 
handling of the situation; and two, how much he was like or unlike himself 
as you have come to know him in the past few days. 

Remember that the most important things arc to be as effective as possible in 
the situation you are given, and to handle it as you actually would in real life. I 
think further description will only confuse you and that you will understand 
exactly what wc are doing after you have seen the first situation. 

The first pair of participants was then called and the outline of the prob- 
lem to be worked out before the group was explained to them in the hearing 
of all. One member of the staff conducted the session. Upon him in large 
measure the success of the improvisations depended. He made the opening 
remarks, instructed each pair of students in the parts they were to take, 
kept time on the situations, and handled the discussion. Three or more staff 
members sat toward the back of the room as observers, taking part in the 
group discussion and acting as sounding boards for comments from the 
candidates. As a rule, there were as many situations as there were candidates, 
each man participating in two. Eight was considered the maximum num- 
ber of situations which could be handled in one session, however, and if 
there were more than eight candidates, some of them took part in only 
one situation. 

Because of the unique function which Improvisations came to serve in the 
assessment process, and because of our belief that it can be one of the most 
valuable procedures for personality diagnosis, it has seemed worth while 
to describe its development. Originally it was employed for the purpose 
of revealing leadership potentialities, with the hope that incidentally other 
components of personality, especially social skills, would be exhibited as 
well. The first situations, therefore, were set up with the two roles in each 
scene clearly defined, one as ’‘superior,” the other as “inferior,” and with 
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some point of conflict between the two characters, Each .staff member 
prepared a number of scripts, and from tlicm, nine were cho,sen. Two are 
given as illustrations. 

1) Mr. F. of this organization has been working as an administrative assistant 
for about two months. He feels he has been doing a good job. Mi.s superior Mr 
G., however, is so dissatisfied with the work of his assistant that lie decides to 
call him into his office. The scene to be enacted is the conversation between Mr 
F. and Mr. G. 

2) E , the leader of a guerrilla band, must order F., one of bis men, to under 
take what IS likely to be a suicide mission. He does not feel tliat he can m 
himself because he will be needed to command the rest of his men, F. feels that 
the proposed mission is not likely to succeed and that he should be' saved far 

something for which he is better qualified. He goes to E. to protest. 'I’he scene 
IS this meeting between E. and F. I . me scene 

A mimeographed copy of the nine scripts wa.s given to each candidate 
who was asked to mark his preferences of roles. It was thought that this 
procedure would give some indication of whether a given candidate had 
a leaning toward leadership or toward dependency. After the men had made 
their choices, they were paired off .and allowed to act out their roles in front 
or the group. Discussion and conmments followed. 

It soon became apparent that little could be ascertained in this way about 
leadership as an isolated trait, but that the procedure was nonetheless re- 
warding: the men were revealing a good deal about their mode., of con- 
du tmg interpersona relationships. The test was then developed along 
much broader lines than had been originally intended. ^ 

proved that the original situations were inadequaie in many 

Md chert wa, little room for a dash of personalities; in oli.ers eheto was 
In ^ L ^^prossion of moods and attitudes. For in.,tance, 

Xl rind ? to block rather than to facilitate indf 

raZt^nr save too much leeway for imagina- 

In order ^ 1 Conflict was not specific enough. 

came to use r/ ^hich we 

• me to use repeatedly and which we felt fulfilled our criteria: 

there He h'as'^h.^ months ago and opened a business 

application and goes to U c ^ Jiothing m response to this 

whom ho Is pkLa, ; ,A 1 /r'””' "’“T »' 

that / has rIJ sS SI “7a 
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Here no mood is set. The neutral tone of “pleasantly acquainted” leaves 
the participants free to express any variety of emotional response. There 
is a minimum of factual argument and a maximum of personal interaction, 
yet there is a definite point at issue. Both men arc put on the spot, one with 
the task of informing the other of his failure, the other of accepting that 
failure. In addition, this situation and others on which we came to rely had 
the advantage of a certain amount of specificity. They could be used for 
free expression, but they were also of value as tests of certain attitudes. 
This one, for instance, proved eflective in revealing in the case of A. his 
reaction to rejection, and in the case of B. his tact and diplomacy. Success 
depended on the exact structuring of the situation and careful casting of each 
candidate so that weaknesses would appear if present. 

There were good reasons for abandoning the original practice of having 
candidates choose their roles, one being that free choice allowed the man 
to adopt the role in which he would appear in the liest light, instead of 
compelling him to play an unfamiliar or uncongenial part which might 
expose some specific defect of character. But, since the role selected for a 
candidate could not be placed entirely outside his sphere of interest and 
competence without running the risk of cliccking his motivation, a special 
role was invented for each man based on his cover story and his postwar 
plans as written out for us that morning. It was comparatively easy to pair 
the candidates in appropriate situations. Each situatiotr put each man 
into a position in which he would have to reveal the faults he was suspected 
of having, if such faults were present. As time went on, a number of 
standard situations were developed which satisfied our criteria and which 
could be used repeatedly, although there were always some candidates who 
required specially created situations. 

When Improvisations was first adopted an attempt was made to use the 
rating system, but this was soon abandoned as incongruent with the subtle 
and unpredictable forms of behavior exhibited under these conditions. It 
was striking, however, that aUhough no formal score could be made, there 
was usually good agreement among the stalT members as to the nature and 
significance of the observed behavior. This opportunity to observe the elusive 
and unique qualities of each candidate’s behavior without the necessity of 
rating it turned out to be the most valuable aspect of this technique, which, 
it was felt, justified the time devoted to it. The procedure brought out 
personality characteristics which had not appeared or had been barely 
discerned in other tests. Immediately after the session the staff members 
would meet for thirty or forty minutes to discuss the behavior of each 
participant and its meaning for his over-all assessment. 

^ These tailor-mnde situations were created by the staH in sessions which they called Brain- 
storms and which were held on tlie afternoon of the day of Improvisations while the candi- 
oates were occupied with the group memory tests. 
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Some of the functions of the ^taff member who conducted Improvisations 
have ali'eady been mentioned. It was his rCvSponsihility to make the idea 
of Improvisations inviting to at least a few of the group within the first 
few minutes, and then to overcome the resistance of the others during the 
course of the performances. He had to present each situation clearly and 
succinctly so that the participants could understand it exactly as it was 
designed, On a few occasions gross misinterpretations occurred which were 
extremely revealing. 

The most important as well as the most diflicult task was to lead the 
discussion of each performance in such a way as to gain the optimal emo- 
tional response from the spectators without increasing their reluctance to 
participate themselves. Maintenance of this delicate balance — in which a 
man is goaded to give himself away as completely as possible while main- 
taining his prestige within the group— was the crux of Improvisations, the 
responsibility for which fell very largely upon the administrator of the 
test. 

First, the administrator had to set the proper tone, by his own enthusiasm 
and air of confidence. He had to be good-humored and yet csta[)llsh the 
idea that the Improvisations were a serious part of the testing program. 
There was some doubt about the amount of humor which vshould be intro- 
duced. A certain amount of levity was clearly helpful in loosening up the 
audience at the beginning and there always was and should have been 
considerable laughter during some of the performances. Most of the Impro- 
visations, however, and surely the more important ones, were serious 
affairs. During the critique some humor was interjected at times to relieve 
tension or embarrassment, but here again most of the significant com- 
ments were made seriously. 

The administrator was also required to stimulate each man’s interest in 
the role assigned to him; and here a simple measure which seemed to 
work well was to change a candidate’s story in such a way as to flatter him 
before the group. For instance, an enlisted man who wanted an army career 
after the war was made an officer. The audience never knew the man’s 
real status, but he felt temporarily elevated in their eyes. It was often neces- 
sary to appeal to a candidate to be himself rather than a ‘^character” and 
to keep this as an objective constantly before the others. The individual’s 
absorption in his part was considered of paramount importance because 
it was felt that the more completely this occurred the more likely he was to 
reveal his characteristic patterns of behavior. 

The presiding staff member decided on the duration of each scene, Ordi- 
narily, he allowed a pair of improvisers to talk for four or five minutes and 
then warned them that they had a minute or two to bring the affair to a 
close. In the cases of complete failure of a scene, of embarrassing awkward- 
ness, or of loss of interest on the part of the audience, the action was 
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terminated as quickly and as gracefully as possible* When the argument 
came down to a matter of technical fact, for instance, nothing could be 
gained by allowing it to continue* When, however, a spirited discussion 
developed which entertained the sSpcctatnrs, the scene might last as long 
as fifteen minutesS, As a rule it was stopped as soon as the trends of the 
two improvisers became obvious* 

As soon as an improvisation was brought to a close, criticisms were in- 
vited by such questions as: “Was Joe like himself in the part?” “How 
unnatural was he?” “Was he acting?” “Is that how he usually behaves?” 
“What would you have done in the same fix?” The men who took the parts 
were asked to comment on their own feelings in their roles: “Were you 
uncomfortable or at home in the part?” “Did you really behave as you 
would have under the circumstances given?” A common tendency was to 
discuss the factual issue involved; and the presiding officer had to be com 
stantly alert to turn attention back to the personalities and behavior of the 
participants. The comments and the cnimtercomments aroused were often 
very revealing. 

When comments by the candidates were not forthcoming, questions were 
directed at particular members of the audience. Sometimes it became neces- 
sary for the staff members to enter the discussion. Their comments might 
be expressed in such a way as to split the group into conflicting sides 
and thus to provoke an argument. At times a deliberately unjust criticism 
by a staff member was necessary to arouse the candidates to a performer’s 
defense. In the same way two staff members sometimes argued a point 
in order to draw the spectators into the discussion. It is clear, of course, 
that such arguments should take place only as “part of the act” with com- 
plete mutual understanding on the part of the staff members engaged. 
Otherwise, the staff will be putting on an improvisation for the benefit of 
the candidates. 

Occasionally anger threatened to wreck the whole undertaking, and it 
was necessary to re-create an atmosphere of good feeling before going on to 
the next improvisation. In any event, as soon as the administrator felt 
that the critique had served its purpose he would begin to work the group 
into shape for the next round* A few joking remarks about the participants 
in the last scene were usually enough to effect this transition. Sometimes 
if a man had shown himself in a bad light, it was necessary to point out 
that he had been placed in a tough spot, thus excusing his behavior, 

It was found that an unbroken two or two and a half hours of impro- 
visations resulted in fatigue, no matter how interesting the scenes, and that 
there was marked lessening of attention and interest as time passed. To 
remedy this, Improvisations was scheduled just before the Debate at which, 
from the very be^nning of S, it had been our custom to entertain our 
guests with hard liquor. Now, instead of waiting until the Debate for our 
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drinks, wc had them brought in at a break that was introduced after 
three or four of the scenes had been enacted. An intermission of five or 
ten minutes allowed time for everyone, candidate or staff member, to pour 
himself a drink. During the rest of Improvisations (and indeed through 
the whole evening) candidates were encouraged, by example and invitation, 
to help themselves whenever they desired. 

The effect of alcohol on Improvisations is difTictilt to e.stirnatc. It some- 
times changed the behavior of a candidate. As migltt l)c expected, the 
timid, self-conscious person gained confidence, and since wc had learned 
little from his previous silence, we considered this a gain. As a rule, in- 
hibitions were weakened and criticisms became freer. If the drinking went 
on too long, the men passed this stage, however, and grew inattentive and 
uninterested, or noisy and difficult to control. Consequently, the practice 
of offering alcohol only during the last hour of the session jiroved most 
effective. At this point it came as a welcome diversion and helped to revive 
interest and energy for the second half of the session. 

What were the psychological factors at work in Improvisations? To this 
question we have no scientific answers; no intensive studies were made, no 
controlled experiments were conducted. But there was general agreement, 
nevertheless, among the intuitive judgments of the staff. 

First, as in all the tests, there was the drive to give a satisfactory per- 
formance, if not to excel, to make a favorable impression on the staff, 
and so to “pass” the examination and be accepted for a position in the OSS. 
The vast majority of the candidates were volunteers; they wanted jobs. This 
drive was heightened by the presence of competitors and the presence of an 
audience. The men wanted to make a favorable imprcs.sion on their team- 
mates. We might call this the need for recognition, for prestige, for the 
maintenance, if not the elevation, of self-esteem. In many candidates the 
complementary negative drive to prevent rejection (by the organization), 
to prevent ridicule and depreciation (by the audience), to prevent a fall 
of self-esteem, may have acted more powerfully than the incentive of suc- 
cess, the image of themselves as masters of the situation. Some individuals 
with an exhibitionistic tendency outdo themselves in public, despite a good 
deal of internal perturbation; for them spectators arc a facilitating stimulant. 
For others, however, a large or formal audience is a deterrent; their natural 
tendency is to avoid conspicuous participation. For these, fmprovi.sations 
was more or less of an ordeal which they could not avoid without abandon- 
ing their proximal goal— to be accepted by the OSS. Thus the social pres- 
sure in the situation was considerable, enough to force everyone to say 
something — whatever it might be — and so to generate in many a good 
deal of tension, anxiety, and embarrassment. Another important factor was 
the pressure of time; there was no opportunity to reflect, to decide on a 
course of action, to select the most telling words. A candidate was com- 
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pelled to give vent to most of the trends and words which were evoked by 
the situation; there was little time to choose among a variety of possible 
tactics. Each man was thrown back upon more or less involuntary action 
patterns, habitual or emotional. 

As a rule, candidates were given roles which we felt they could not 
fulfill successfully. Many of them sensed this; they realized they vyere on 
the spot. Also, their dillicuhies were augmented by the element of surprise 
which was introduced into most of the scenes. 'Ihe stable candidate who 
felt more or less at ease in the situation usually handled it satisfactorily in lus 
accustomed way. The obtuse individual, unaware of his faults, also carried 
on as usual. But then there was another type, the man who realized that 
the pattern which was natural to him would convey a bad impression and 
that he had to substitute some other mode of behavior which we 
distinguish as the made-up-on-the-spur-of-the-moment reaction. Insigitful 
candidates in the audience were often quick to recognize these suddenly 

invented, unnatural patterns of behavior. _ 

When a candidate had the thought that his first spontaneous idea tor 
action would prove inadequate or reveal too much of his deeper feelings, 
he might respond in any one of several ways: the most comrnon was 
immobilization, momentary spccchlcssness. In some exU'cme cases there was 
complete inability to carry on. As a rule, after this initial blocking, the man 
would continue but diverge from the original script. At times this reaction 
appeared to be due to the loss of the original instructions amid the turmoil 
of his emotion. At other times the man seemed to be working deliberately 
away from the original argument, substituting a plot of his own which was 
more manageable. 

Frequently a candidate would resort to “ham acting to avoid revealing 
himself, even though the whole group had been repeatedly warned against 
this course. “Ham acting” almost invariably drew laughter from the candi- 
dates, which relieved tension for the moment. The deep einotional involve- 
ment of such an actor would often be displayed in the discussion which 
followed, when he responded heatedly to criticism of his mode of dealing 
with the problem. Sometimes a person would display a hostile or resistant 
attitude to the proceedings when first presented with a role and woul 
refuse to take part on the grounds that the whole affair was pointless. 
One case which illustrates several of these points is worth citing. 

A young man, very able in his field, was suspected of having a very low 
tolerance for adverse criticism, the suspicion being based largely on reports 
we had received on him from outside sources. Very little of this came out in the 
interview or in his general behavior at S. He was put into an improvis^ion in 
which he, as an actor, had been severely “panned” by a drama critic. He was 
deliberately put up against a very cool, smooth-talking fellow. 

In this situation the candidate displayed a great deal of genuine anger, stormed 
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at the “critic/* and finally pretended to shoot him. When his colleagues criticized 
this “solution of the problem/* he defended himself by saying that of course he 
put on the shooting simply as a gag. 

Later in the evening, he was put into a somewhat similar sltuatioii. This time 
he put on a very “hammy” act, tried to be funny, and, although the two scenes 
were really unrelated, he managed to worm in an apology for the previous 
“murder.” After this scene, the candidates were reluctant to criticize him. 
A staff observer, however, asked him flatly why he had put on such an act after 
being told to behave as naturally as possible. He became very bitter in defend- 
ing himself, criticized the way his scene had been set up, condemned Improvisa- 
tions in general, and showed a marked lack of insight into the difficulties of 
personality which at the moment he was manifesting in his behavior. In this 
case, as in many others, the improvisation was useful as confirmation of an 
hypothesis. 

Improvisations is a technique by means of which a person is led un- 
wittingly to reveal his typical social attitudes. It is used best ns a supplement 
to other methods, to prove or disprove the presence of specific traits or 
trends which are suspected on the basis of previous findijigs. 

We have come to feel that the emotional involvement of the improviser 
both in the situation and in the succeeding critique is die sine qua non of 
a significant expression in Improvisations. Creating this involvement 
should be the aim of the staffs efforts. We are inclined to feel that under 
these conditions the individual gives a more accurate impression of his 
methods of dealing with others than can be obtained in any other way. 

After the last improvisation the staff members withdrew to the conference 
room to discuss the meaning of the behavior they had just seen. The meet- 
ing lasted from a half to three quarters of an hour, during which time the 
candidates were free to do whatever they wished. Most of them remained 
downstairs, continuing to drink and discussing animatedly their perform- 
ances in Improvisations. It might have been rewarding to have had 
members of the staff mingle with the candidates at this time to hear what 
they had to say about each other. But, on the whole, It seemed wiser to 
leave them to drink as freely as they wished, in order to lessen any suspicion 
which may have arisen that liquor was being offered as n test of their 
discretion and control. Of course, in large measure, it was just this, but 
we did not wish to underscore the fact. First, by drinlcing with the can- 
didates we sought to emphasize the social nature of the occasion, then by 
withdrawing we hoped to make them feel that in no sense were they being 
subjected to unrelenting scrutiny. After all, wc would join them later 
and have plenty of time in which to note their drinking habits. 

It was our hope to make this evening a pleasant time of relaxation for 
the candidates and if incidentally wc discovered that some of them drank 
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to excess, or could not hold their liquor, or talked too much under its 
influence, this was so much grist for the assessment mill. Of course it was 
not the amount of liquor that a man drank as such which concerned us, but 
how he behaved after drinking that amount. The fact that a person drank 
to excess was not by itself sufficient cause to “ding ' him, nor, on the other 
hand, could we ever be sure that a man who drank nothing was not an 
alcoholic. But when a man, knowing full well, of course, that he was 
being assessed for an assignment overseas, drank to the point where he 
broke cover seriously, or revealed difficult and unpleasant traits of person- 
ality, or became sick, or showed, in any other way, a marked deficiency 
of control, this was ground, certainly, for questioning his suitability; and 
such lack of control was exhibited often enough to justify many times over 
the expense of the never-mentioned, never-named liquor test. 

Debate.— When, upon completion of their conference, the staff members 
returned to the living room, it was to attend a group situation in which all 
candidates would participate. This was the Debate, though actually it was 
not so much a debate as it was an informal panel discussion. The topic 
chosen for discussion was a timely one. In the early days of 19^4 it was 
“What are we fighting for?’* and the candidates were arbitrarily divided 
into two groups which were sent to separate rooms to prepare their argu- 
ments before being called back to the living room for the debate. Later 
the procedure was changed so as to ensure more opposition between the 
sides, by having the candidates set down their opinions on an attitude scale 
and then dividing them into two groups on this basis. For example, with 
such a topic as “What shall we do with Germany after the war?” each man 
was asked to place himself on a scale of opinion running from (i) — “A 
lenient peace with restoration of Germany to the family of nations as rapidly 
as possible”— to (10)— “The destruction of the German slate as we now 
know it.” Thus one team was composed of those who favored more 
lenient measures and the other of those who advocated harshness. Other 
topics for discussion included, among others, “What shall we do with Japan 
after the war?” “Can we trust Russia in the postwar world?” 

A member of the staff acted as chairman for the Debate, After announcing 
the topic and the composition of the opposing teams he directed them 
to retire to separate rooms where they would have twenty minutes for a 
discussion and formulation of their views and policies. He suggested that 
each team select a chairman to organize the discussion as well as the 
presentation of its position, but he also stressed the fact that although 
agreement was desirable, minority opinion should not be disregarded. 

When the men separated, it was customary for a few staff members to 
join each group and sit to one side observing events as inconspicuously 
as possible. Usually the candidates would start by airing their individual 
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views without deciding on a plan of procedure, but before very long the 
need for organization would become apparent and often at this point a 
chairman would be selected. Sometimes he was self-appointed; sometimes 
he was appointed by a dominant and assertive incml)cr of the team; some- 
times he was elected. Other groups, however, merely chose a secretary or a 
temporary chairman, postponing the election of their real leader until just 
before the debate. At times this policy was adopted by the men to ensure 
their having the best leader when they faced the opposition, but in other 
cases it was a matter of the last-minute ditching of a chairman who had 
proved to be unfair or ineffectual in conducting the group meeting. Some 
teams obviously chose the man who had most impressed them with his 
knowledge, but others with less foresight chose a man who had been a 
leader in some earlier situation or simply an older man whose appearance 
and manner commanded respect. Once the group became organized, each 
man would have an opportunity to express his views and to suggest strategy 
for meeting the opposition. 

These meetings of the teams in preparation for the Debate were often 
most revealing. Though the staff members made it a rule never to make 
written notes during the evening lest they inhibit the candidates in the 
free expression of their opinions, they were constantly alert to all forms 
of behavior which might serve as a basis for the ratings which they would 
make either before going to bed that evening or early the next morning. The 
traits to be rated when possible were Energy and Initiative, Effective Intel- 
ligence, Social Relations, and Leadership. It was hardly possible to rate all 
these variables in all candidates because of the large number of men in- 
volved, and the length of time that inevitably elapsed between the making 
of the observations and the recording of the ratings. 

When, after twenty minutes, the two learns were called together in the 
living room, they were seldom as well prepared as they had hoped to be, 
but the intellectual resourcefulness of the candidates could be better estimated, 
so it seemed to us, when they were forced to organize and express their 
thoughts under the pressure of time. 

In opening the Debate, the staff member acting ns presiding officer made 
it clear that the affair was to be informal, that the men could dispense 
with the customary “Mr, Chairman^’ or “my honorable opponent,*’ and 
finally, that there was a rule that glasses be kept filled. Everyone, he said, 
was to feel free to fill his glass at any time; formality was out for the 
evening. At this point the staff members interrupted the speaker by walk- 
ing up and filling their glasses, an example followed by a majority of the 
candidates. 

Depending on the amount of responsibility spontaneously assumed by a 
chairman, the presiding officer cither kept in the background or took over 
his functions by calling on the members of his team, keeping time, and 
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encouraging participation by everyone. His aim was to create and maintain 
a free and easy atmosphere, to entice the reluctant candidates to speak, 
and to partition the time fairly among those who requested it. 

In order not to influence the expression of opinions, neither the moder- 
ator nor the other staff members took any part in the argument. The usual 
procedure was to start by having each chairman address the entire assembly, 
presenting the major points agreed upon by his team, offering a few salient 
arguments himself, and then calling upon his colleagues one by one to 
speak briefly on the special aspects of the subject about which they pre- 
sumably knew most or about which they felt most strongly. It sometimes 
happened, though, that a chairman, either at the request of his group or on 
his own initiative, spoke for the entire time allotted to his side. In any 
event, after both groups had presented their views, they were allowed a few 
minutes in which to prepare rebuttals and then about five minutes in which 
to present them to the assembly. When the rebuttals were finished, it was 
customary for the moderator to suggest that the men elect one of their 
own number to preside over the general discussion that would follow and 
to stress the fact that they were free to pursue the topic in any manner 
they saw fit; moreover, anyone who was tired or uninterested could go to 
bed (by now it was likely to be well after eleven o’clock). 

Though the Debate was in some ways similar to the round table Dis- 
cussion of five or six participants, in other ways it was quite different. 
In both cases there was a timely topic to be discussed and in both the 
same variables of personality were rated. However, the larger audience, 
the division of the group into two teams, the use of debating techniques 
with the speaker standing before the whole group, and, perhaps most of all, 
the liquor, made the Debate qualitatively quite different from Discussion. 
The Debate presented a better opportunity than did Discussion for a 
display of eloquence in formal speeches, for objective or emotional argument 
in rebuttal and counterrebuttal, as well as for organization and leadership 
on a larger scale. In addition, by the end of the second full day, when 
the Debate took place, the candidates were better acquainted with each 
other and better adjusted to their environment than they had been at the 
time of the Discussion. This resulted in greater freedom of social inter- 
action, Because of these many differences between the Discussion and the 
Debate, the value of the latter was not confined to what it supplied in 
the way of confirmatory evidence of previous conclusions. Very often the 
Debate revealed new aspects of a candidate’s personality which led to a 
rounding out or to a modification of the conception held at that time. 

The quality of the candidates’ contributions to the Debate varied greatly, 
depending on their knowledge, intelligence, and facility of expression. The 
speeches of many were merely repetitions of glittering generalities and hack- 
neyed phrases, delivered in a stumbling awkward fashion; other men pre- 
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seated forceful and fervent appeals; still others contributed competent, well- 
organized, and informative discussions of the complex problems at issue. 
The Debate provided an excellent opportunity for candidates to display 
whatever special knowledge or propaganda talent they possessed. It also 
served to evoke assertions of emotional and ideological sentiments and atti- 
tudes such as vengefulness, a passion for justice, for democracy, abhorrence 
of aggression, humanitarian sentiments, and so forth. Confirmed political 
attitudes were often revealed, especially by foreign-horn candidates who 
had programs of reform for their own countries. Information of this sort 
was often valuable in deciding a candidate’s fitness or unfitness for a par- 
ticular job. Expressions of feelings of national superiority or racial intoler- 
ance, for example, were indications that a man was not well suited for a job 
that required sympathetic understanding and tactful handling of native 
peoples. 

As in other procedures, there were always some candidates who did not 
actively participate, A few in each class never spoke unless called upon and 
then only briefly; they were usually the ones who became bored as the 
evening wore on and were among the first to go to bed. Nondrinkers were 
also apt to retire early, especially if it happened to be one of those occasions 
which developed into a real party. Some candidates .sat back quietly and 
drank, giving no more than half an ear to the arguments; others, getting 
drunk, boisterously interrupted the speakers with more or less humorous 
comments; others went further and tried to transform the meeting into 
an out-and-out drinking party. Unruly behavior, however, was exceptional. 

Candidates who became intoxicated revealed things that would never 
have been so apparent had they remained sober. Some made serious breaches 
of cover; others exposed deep prejudices or extreme political leanings which 
they had more or less successfully concealed up to that time. One man who 
in earlier tests had given hints of rather bizarre fantasies exhibited a well- 
developed persecution complex in a speech loaded w'ith warnings against 
a preposterous trap that was about to be laid in the government. Another 
spoke in tones frankly sympathetic with the Nazis when earlier he had 
claimed that he was a German refugee and an anti-Nazi. Another candidate 
who had maintained a resolute calm and detachment for two days showed 
how inveterate was this mechanism of defense by making every effort 
for an hour or more to appear sober and poised, when actually, having 
drunk to excess, he was on the verge of becoming violently ill. One middle- 
aged man, who had boasted of his drinking prowess to a staff member, 
drank a quart of brandy in about fifteen minutes and promptly passed out 
cold. 

After the Debate was over most of the candidates and some of the staff 
members were apt to remain downstairs drinking and talking, often into 
the early morning hours and, as one might expect, significant trends of be- 



Assessment at S: Procedures 181 

havior occurred at this time. Sometimes a long and serious discussion of 
world affairs developed; more often it was an occasion for reminiscing 
(with or without breaking cover) and storytelling; sometimes the meeting 
turned into a song fesl, or broke up into liitle groups filling the air with 
barbershop harmony. 

For the candidates this was a long-to-be-remembered evening of pleasant 
relaxation, especially welcome to those who had been in service for a long 
time, and appreciated the more by all, coming, as it did, immediately after 
the exhausting obstacle course, at the end of two days of unrelenting 
effort. It provided a better opportunity than they had yet had to get to 
know their fellow candidates and members of the staff. Much that they 
learned this evening would influence their ratings and their personality 
sketches of each other which they would be asked to give the next morning. 

THIRD DAY 

Sociometric Questionnaire and Judgment of Others.— By the morning 
of the third day of assessment the candidates had become pretty well 
acquainted. They had been engaged in numerous undertakings with the 
members of their own subgroup. They had come to know the others, too, 
through living in close quarters with them. In Improvisations they had 
had a rare opportunity to watch at least half of their class perform under 
pressure, and in the relaxed and convivial atmosphere of the Debate they 
had heard every man speak at least once and had observed some in a new 
light. This, then, was the appropriate moment to get from each man his 
opinions of the other members of his class. From 8:30 until noon they were 
kept busy writing their judgments or, let us say, assessments, of each other. 
The procedures used for this purpose were answering a sociometric ques- 
tionnaire about their associates and writing personality sketches of those 
whom they had come to know best. 

The results of these techniques can be immensely valuable or completely 
worthless, depending upon the degree to which the subjects can be induced 
to take the assignment seriously and to execute it with complete honesty 
and candor. In preparation for it, candidates had been told upon their 
arrival at S that before leaving the area their ability to size up others would 
be tested. But advance notice was not enough; it was important that the 
instructions for the Sociometric Questionnaire and the Judgment of Others 
be given to the candidates so as to make them feel that in writing fully 
and honestly they were serving the best interests of themselves, their 
associates, and the OSS. 

The instructions for both tests, given by the director of S, were as follows: 

Since arriving the other day you have been asked to do many things. This 
morning we have something else for you to do, something which some of you 
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may find difficult, but something which we on the staff consider very important, 
When you arrived you were asked to get to know one another and told that 
before you left your ability to judge each other would be tested. Now the time 
has come, and this morning we would like to ask you to come on the staff 
as psychologists and give us the benefit of the insights into your associates which 
you have gained during your stay here, There are two reasons why we will ask 
you to indicate to us what you think about your fellow men in tins class. 
First, we know that you can help us, You have been living with each other 
in a more intimate manner than any of us on the staff have been able to live 
with you and it would be strange indeed if you have not seen aspects of one 
another which we have missed. We know from the aid which past classes have 
given us that you can help us very much in our attempt to understand you. The 
second reason why we ask you to write about each other this morning is, frankly, 
to test your ability to size up other people. We have given you a number of tests 
and observed you in many situations and we have a pretty good idea of the 
kind of people you are. Now we want to discover what is the correspondence, 
or lack of correspondence, between the judgments which we have formed of 
you and the opinions which you have formed of each other. We give you this 
test because we believe that the success of whatever mission or job you will 
carry out in this organization will depend in large measure upon your ability 
to judge others accurately. 

Now the assignment this morning consists of two parts, First, I shall give each 
of you a sheet of paper with a number of questions typed on it and attached to 
that sheet, a slip of paper with the names of the members of the class with a 
number assigned to each man's nanae. We would like you to answer the questions 
by writing after them the numbers corresponding to the names of the men who, 
in your opinion, have the traits or characteristics indicated in the various 
questions. For example, one question reads: “Whom would you recommend as 
supervisor of a group dealing with problems of planning and organization?’* 
After that question write down the numbers which correspond to the names 
of the men who, in your opinion would be good at supervising groups dealing 
with problems of planning and organization, Write down the numbers of as 
few or as many men as in your opinion would be good supervisors. Another 
question reads*. ‘If you were a member of a group on a dangerous mission, 
whom would you prefer to have as your leader?** After this question write 
down the numbers assigned to the men whom you would like to have lead 
you on a dangerous mission. Again put down the numbers of as few or as 
many men who in your opinion would be good leaders of a dangerous mission. 
And so on with the other questions— eleven in all. There is no time limit to this 
first part of the assignment. It will probably take you one half to three quarters 
of an hour to finish. When you do so, will you please take your answer sheet 
upstairs and place it, face down, in the basket on the tabic outside the staff room. 

Now for the second part of the assignment, I shall give each of you five blank 
sheets of paper and ask you to write on the sheets personality or character 
sketches of those five men in the class whom you have come to know best. 
Write one description on each sheet— five descriptions in all. At the top of the 
page write your own name and then under that the name of the man you 
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^re about to describe, Wc would like you first to describe his traits of personality, 
of character, of mood and temperament, his special skills, his unique abilities, 
his traits which you feel would be pleasant and agreeable as well as those which 
would be irritating and disturbing. It is important to give the full and complete 
description of the man. You may hesitate to write down those things which would 
seem critical or unlavorablcj and your hesitation to write them is certainly 
understandable; but I would like to point out that it does no service to the man 
or to the organization if we blind ourselves to what may seem to be a man’s 
negative traits or the less favorable aspects of his nature. If such traits are 
recognized there is without doubt a place for the man where those traits will 
not interfere with his performance or his relations with others, but if they are 
not recognized the man may be put in a position where he will fail and where 
others will be hurt. Then, too, remember that this is a test of your ability to 
judge others and that you will be scored upon the keenness of your psychological 
insight in the descriptions which you write this morning. If you sec only half 
of the man, whether it be the good half or the less favorable half, you are not 
so good a judge as though you see the man in his entirety. It is the full 
and complete picture wc want, and if you are a good judge of your fellow men 
you will be able to give that full picture. So make your descriptions just as full 
and just as detailed as you can. Flaving written the personality or character 
sketches, please draw a line, cither at the foot of the page or on the back of the 
sheet, and under that line put down those things which you think arc reasonable 
guesses about the man’s past experience and background. Having written these, 
draw ar].other line, and under it please indicate whether or not you saw the 
man before getting into the truck with him in Washington, If, having seen him, 
you know his military or civilian status, or his rank if he is in the service, 
please so indicate. 

Finally, if you have known the man about whom you write for a longer 
period than the time of your acquaintanceship here at S, will you indicate at 
the top of the page the approximate length of time that you have known him. 
If you have known a man before coming to S there is no reason why you should 
not write about him. As a matter of fact, we wish you would write about 
those you have known for a longer time. Your descriptions in such cases wiU 
probably be more detailed, more accurate, and accordingly more valuable for us, 
but since we are scoring you on these write-ups for your ability to judge others, 
it would be unfair to score descriptions based upon a longer acquaintanceship on 
the same basis as descriptions based on short acquaintanceships. So if you have 
known the man before coming to S, please indicate that fact, stating the ap- 
proximate length of time of your acquaintanceship — two weeks, six months, a 
year, or whatever the time may be. The man about whom you will write will 
probably return the compliment and write about you and indicate similarly that 
he has known you for a longer period of time than your short stay at S. 

Are there any questions about this assignment? If not, I shall give you these 
papers. You will have until twelve o’clock to finish your writing of the five 
personality sketches. We give you ample time in which to do this, for wc con- 
sider this an important assignment. When you have finished the descriptions, 
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will you take them upstairs and leave them, face down, in the basket on the 
table outside the staff room door. 

Now this is the kind of job which, if it is to be done well, must be done 
with a feeling of psychological free space. Accordingly, I would like you to feel 
free to move these chairs around any way you wish or even to take these papers 
into the living room and write there, or up to the bedrooms, or outdoors, And 
if you feel you know a man well but have forgotten his name, do not hesitate 
to go up to him and read his name tag or ask him what his name is, 

All right, you have, then, until twelve o’clock to finish your writing. Please 
be back here at that time. 

socroMEiTtic QUESTIONNAIRE.— For tliis part of the morning’s assignment each 
candidate was given a copy of the following questionnaire with instructions 
as indicated. 

Instructions, Here are a few questions for you to answer about the members 
of your group. Think about the men carefully before you answer the ques- 
tions. Then answer each question by putting down the numbers of the men 
whom you choose. You may mention as many men as you wish in answering 
each question. Do not hold bac\ any honest opinion. 

1) With whom would you enjoy continuing your acquaintance? 

2) Which men expressed the most realistic and convincing opinions in the 
debate last night? 

3) If you were given the responsibility of picking men who would have to 
live together and work together on a group project, which men would 
you hesitate about because of their difficulty in getting along with others 
over a long period of iimef 

4) Whom would you recommend as supervisor of a group dealing with prob- 
lems of planning and organization? 

5) Whom would you be inclined to avoid socially? 

6) Which men were the most inconspicuous; i.c., least noticeable? 

7) Which men seemed to get along most easily with the other members of 
the group? 

8) If you were a member of a group on a dangerous mission, whom would 
you prefer to have as your leader? 

9) Which men seemed to antagonize other members of the group? 

10) With whom do you feel you could work most harmoniously? 

11) What men, if any, annoyed you by talking too much or being too dogmatic 
in their statements? 

No limit was placed on the number of choices permitted in response 
lo any of the questions, nor was a candidate compelled to list anyone 
in response to any question for which he felt he could make no honest 
choice. 

Originally the candidates were requested to rank their choices if more 
than one choice was made for any question. During the experimental stages 
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the number of choices allowed was sometimes limited, sometimes unlimited. 
The ranked data were analyzed by various statistical procedures which 
weighted the choices in accordance with the rank. The same data were then 
analyzed by assigning equal weight to each choice, no matter what the 
rank. This last method correlated at least .90 with any other analysis of the 
data. It was therefore adopted as regular procedure since it had the advan- 
tage of being simple and timesaving. 

Questions i, 7, and 10 indicated the extent to which a man was accepted 
by the otlier members of his group. There was some relation among 
the answers to the three questions. Usually more candidates were listed 
in answer to Question i than to Questions 7 or lo. Those who were only 
mildly accepted were generally listed under Question i, while the candidates 
who were accepted more wholeheartedly were listed under one or both 
of the other questions as well. For each man an acceptance raw score was 
computed by adding up the total number of times his name was mentioned 
by the other members of his class in answer to Questions i, 7, and 10. 

In the same way, Questions 3, 9, and ii indicated the extent to which a 
man was rejected by his classmates; the answers to Questions 4 and 8 
were combined to give a leadership raw score exactly analogous to the 
other two. 

Until late in the program, when Propaganda Skills was changed 10 refer 
specifically to written propaganda ability. Question 2 was considered by the 
staff before assigning the final score on this variable. Question ii revealed 
which of the outstanding participants in the debate of the previous evening 
had antagonized their classmates by their forwardness, It sometimes oc- 
curred that a man who dominated the debate in a self-assertive manner was 
not listed in response to this question, although he had seemed presumptu- 
ous and overbearing to the staff. Without the questionnaire it would have 
been difficult to realize his actual success and his true (or potential) ability 
as a leader. 

The statistical treatment of Questions 2, 6, and ii consisted merely of rank- 
ing the members of a given class according to the frequency with which 
they were mentioned in response to each question. Only the extreme ranks 
were regarded as significant. The scores on leadership, acceptance, and re- 
jection, however, were thought to be somewhat more important and so were 
converted to lit the standard six-point scale. 

There was a great deal of variation in the different classes which were 
a.sscsscd at S, not only in size but also in composition. It was desired, how- 
ever, that the sociometric scores be as nearly as possible independent of 
these variations so that they would be comparable from class to class, as 
well as within a given class. To this end statistical tables were drawn up 
which corrected not only for differences in size of class but also for differ- 
ences in the general readiness of the members of a class to accept each 
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other, reject each other, or choose each other for positions oMeadership/ 
h addition to this standardized information, the Soctometrtc Questton- 
naire yielded other data of a more qualitative sort. It was easy to cktermine 
r only how frequently an individual was accepted by his classmates, 
but also to what eient he accepted others. For each class charts were pre- 
paJed showing whom each person accepted and by whom he. in turn, was 
Lcepted, whom he rejected and by whom he was rejected, which men he 
p cked as leaders and which men picked him. Some individuals seemed to 
be more acceptable to the men in their subgroup, who presumably knew 
them best; whereas others were more acceptable to the men who knew 

^'^Kagrams were also drawn showing the relative standing of the membas 
of the^ class on acceptance, rejection, and leadership. An indication of the 
cohesiveness of the group could be obtained, first, by noting the average 

the statistical theory and method employed was this! All the members of a elass 
coulS be LrtVd on a linear scale according to the degree to wh.eh they were, fo' 
acetpted by their classmates. The Th^ mMsure "'of TmrnT deviation from 

acceptances received by j j„,ptance) wa, taken as the probability 

t'-t o“ (te by rfndom sampTng) » nLber of acceptances as large 
Is the Lmbcr which he actually received. The smaller this probability, the greater the dcvia- 
:L?waXm raverage and hence the higher the acceptance (it above average) or the lower 

The °chancrpfobability of obtaining a given number of acceptances was 
tables of the bhiomial distribution. In any specific group the probability of a given numbe 
of acceotances depended both on the number of individuals in the group and on tlic averag 
number of acceptances which die group gave. It these aeeeptanecs were given 
that is. if there were no correlation between the fact of a man's bemg accepted by individual A 
Ind his beinTaaeplcd or not accepted by B, C, and D. then the actual d.str.buuon of e- 
ceptances would follow the theoretical binomial distribution. However, because 
Sney with which a man who was accepted by one person was also accept d by otl ers. 
Lre was a great excess of individuals with very high or very low «\cnt of 

verting to our six-point scale it was necessary to make some assumption about « 

this cLelatioQ between acceptances in order to determine tlie proper standard rating for each 

probability level on the binomial distribution. j - nnmKpr 

The first working assumption was that a standard rating of 5 would correspond to a number 
of acceptances so great that it would be obtained only once in 10,000 times y ran oni 
sampling, and a standard rating of 4 would correspond to a number so great that it wo 
occur only once in 100 times by random sampling. A standard rating of o_ would 
to a number of acceptances so stnull that it would be obtained on y once in 10,000 times y 
random sampling, and a standard rating of i to a number so small that it would o" ^ 

once in 100 times. A rating of 3 would represent a number of acceptances that was above he 
mean but not sufficiendy improbable to justify a 4, and a rating of a would represent a number 

that was below the mean but not low enough for a 1. ,1,1, i.ir. 

The same method of analysis was used to convert the rejection scores and the Icatlcrsmp 
scores to standard ratings on the six-point scale. Experience with a larger number ot classes 
showed that, while the probability levels we originally set up as equivalent to standard ratings 
were satisfactory in the case of the rejection scores, they did not allow enough i s and 4 s on 
acceptance and leadership. For this reason the boundary line between a rating of 3 and a 
rating of 4 on these two variables was changed to a number of acceptances so great t ia J 
would occur twice (instead of once) in 100 times by random sampling; and the same c lange 
was made in the boundary line between i and 2. 



Assessment at S; Procedures 187 

number of choices made by the candidates in response to the acceptance and 
the rejection questions 5 and, second, by drawing lines on these two diagrams 
between those members of the subgroups who accepted each other (mutual 
acceptances) and those who rejected each ocher (mutual rejections). A 
closely knit group showed many of these lines on the acceptance diagram 
but few on the diagram of rejection. Other types of relationship stood out 
prominently on these diagrams. An isolate was outstanding when mutual 
acceptance lines connected all the members of a subgroup except this one. 
Similarly conspicuous were small “mutual admiration societies” composed 
of men who accepted each ocher wholeheartedly, but rejected and were re- 
jected by the remaining members of the class. 

Considerable weight was given to the sociometric findings in deciding 
the final rating on Social Relations, since it was felt that the ultimate test was 
the man’s cathexis (valuation) in the minds of his associates. In some cases, 
however, the staff overruled the verdict presented by the sociometric scores; 
in the case of an individual, for example, who revealed defects in character 
which, it was felt, would be unbearable over a long period but which had 
been overlooked by his fellows during the three^day assessment period be- 
cause of compensating qualities. A more common illustration would be 
that of a man of great sincerity and good will who was too quiet to impress 
others with his worth in so short a time, and so was both accepted and re- 
jected by very few. For the most part, however, there was a fairly high cor- 
relation between the final rating on Social Relations and the sociometric 
scores (see Table 62, Appendix C). 

Judgment of Others.^ — For this test each candidate was given five sheets of 
paper, one for each of the personality sketches he would write. 

The finished sketches were analyzed with three objects in mind: 

1) To determine the psychological insight of the writer. The ability to 
size up others correctly, to estimate their merits, to sense their thoughts and 
feelings, seemed to us an important factor in the establishment of good social 
relations and in the conception and execution of any program of propaganda. 
Incidentally, the assignment to write five personality sketches proved to be 
a fairly good test of projection: to attribute one’s faults to others is a com- 
mon tendency. 

2) To obtain in detail, as was not possible in the Sociometric Question- 
naire, information as to why candidates were accepted or rejected or picked 
as leaders by their associates. Also a few other facts of significance were 
often to be culled from these sketches. 

3) To determine the extent to which candidates had broken cover among 
themselves. If several men in writing about the same candidate reported 

*The ijistructions for this test were given along with those for the Sociomctric. For a de- 
tailed account of both instructions, sec pages 182-183. 
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similar correct facts about his past, it was safe to assume that the man in 
question had been indiscreet. Naturally the obvense did not hold: there was 
no proof that a man about whose past the candidates wrote nothing had 
not talked about himself. Perhaps his friends did not wish to give him away. 
The personality sketches, however, did call attention to several serious breaks 
in security. 

The collection of sketches written about each candidate was submitted to 
the staff member who had interviewed the candidate, and each sketch was 
rated on our six-point scale on the goodness of the psychological insight 
which it revealed. Later the grades received by each candidate for each of 
the five sketches he wrote were totaled. Final ratings of the candidates* abil- 
ity to judge others were then assigned in terms of the distribution of these 
totals. The interviewer also assigned a cover rating for each of his inter- 
viewees based on the amount and importance of the information the writers 
of the sketches had obtained about him. 

This method of scoring did not prove satisfactory. The character sketches 
were, of necessity, very hastily read by the interviewers, They received the 
write-ups a few hours before staff meeting on the final day. At that time 
they were engrossed in the all-important task of writing their final reports, 
and the job of scoring the candidates’ sketches could be regarded only as 
an interruption. As a result, the interviewers* ratings on this test were far 
from reliable, Furthermore, some interviewers were found to rate these de- 
scriptions consistently high, while other interviewers were more severe in 
their scoring. (Mean scores from different interviewers ranged from 2.0 to 
3.1.) This meant that a candidate*s rating on Judgment of Others depended 
not only upon the quality of the sketches he wrote, but also upon which in- 
terviewer happened to rate them. 

Yet, despite the Impressionistic nature of the ratings of these personality 
sketches, the fact remains that the sketches themselves were often of con- 
siderable value in forming our final judgments of candidates. Indeed, not 
infrequently a candidate succeeded in describing an associate so aptly that 
we felt we could do no better than to quote his comments in writing up 
the personality sketch for the branch administrative officer. 

During the whole of the third’ clay, most of the staff members were oc- 
cupied scoring tests, meeting in team conferences to decide on the contents 
of their reports, writing them, and, finally, from thrcc-thirly until ten in the 
evening, with an hour*s break for supper, meeting in staff conference to 
discuss each case and arrive at a recommendation as to suitability. With the 
exception of one final score on the athletic events of that afternoon, the col- 
lection of data involved in the assessment of the candidates was completed 
by noon, when the last of the personality sketches for the Judgment of 
Others Test had been written. 
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Since the candidates could not be received in Washington until the next 
morning, after the reports on them had been delivered, something had to 
be invented to keep them busy and contented during the afternoon and 
evening of this last day. For this purpose one final problem was presented 
to them with the same seriousness as all other tests and projects had been 
presented, This problem, the Murder Mystery, was described as a test of in- 
vestigative ability as well as of the ability to make correct inferences. Its exe- 
cution was pursued energetically, but usually with increasing awareness of 
the mock nature of the whole endeavor, until ten o’clock in the evening, 
when the several candidate-teams announced their solutions at the final 
evening session, over which a member of the staff presided as chairman or 
ludge.’^ 

Murder Mystci^. — At noon the candidates were assembled and given copies 
of the mythical Fairfield Chronicle^ announcing in some detail the 
discovery of the dead body of a woman on a road not far from S, They were 
told that it was up to them to investigate this occurrence and decide whether 
the presumption of suicide subscribed to by the local district attorney in the 
newspaper was correct, or, if they found evidence of foul play, to discover 
who commilted the murder. Inasmuch as the candidates were not permitted 
to leave the area, they were invited to question certain designated members 
of the junior staff who were supposed to have been to the village recently 
and picked up a little information. The candidates were cautioned that 
these staff members had heard a great deal of gossip and it might be dilTicult 
to extract the specific items required for the solution of the case. Anyhow, 
the staff members would have to be approached in the right way and the 
questions they were asked would have to be properly phrased and based 
upon correct hypotheses. 

In investigating this tragedy the candidates worked in three competing 
groups of six. The composition of these groups was the same as it had been 
throughout the program. Thus, the carrying out of this assignment became 
something of a game in which each team tried to keep from the other two 
whatever facts it had been able to discover and the promising hypotheses 
it had reached. 

A familiar element of fanuisy was discovered by the candidates as soon 
as their investigations of this crime disclosed that the deceassed was inti- 
mately associated with a number of fictitious personages with whom they had 
become acquainted in several previous tests, namely Belongings, Brief Case/ 
and, indirectly, the Terrain Test; and furthermore, that these connections 
established the possibility of the existence of further criminal activity in the 
vicinity. Challenged by this tie-up to recall the details of previous tests, and 
irritated or amused by the suddenly assumed reticence and bucolic naivete 

® Given for a long period at but not during tlic last months, 
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of the informants, the investigating teams developed their solutions by 
methods that varied widely, depending on the ingenuity and perspicacity 
of the participants. 

Three of the junior staff members designated as possible informants pos- 
sessed certain items of evidence, botli direct and hearsay, that gave dues to 
the solution; in addition they, like all members questioned, frequently en- 
couraged false leads when the candidates asked irrelevant questions. Before 
the investigation had proceeded an hour, the candidates usually found 
themselves possessed of a large number of unconnected clues and irrelevant 
data which produced a distinct sense of frustration, combined with amuse- 
ment, irritation, discouragement, or increased determination to solve the 
problem. 

Two typical scenes between Sid, a member of the staff, and a group of 
interrogating candidates are recorded below as illustrative of the frustrating, 
yet good-humored, situations which developed in the course of the Murder 
Mystery investigation. 


Chorus: 

Sid; 

Ablo: 

Sid: 

Ablo: 

Sid; 

Ablo: 

Sid: 

Bill: 

Sid: 

Carl; 

Sid: 

Ablo: 

Sid: 

Ablo; 

Sid: 

Ablo: 

Sid; 


The Demise of Mrs. J. W. Weel{S 
Scene ] 

The living room, immediately after lunch 

Hey, Sid, can we talk to you a minute? 

Certainly, fellows. I’ve got a stop watch here and can time you. 

Do you mind sitting down? 

Not at all. rd rather sit than stand. And, of course, I’d rather stand 
than kneel, and rather , . . 

We’d like to ask you a few questions. 

Oh, of course. You probably have a hangover from tliat little inter- 
view in the dungeon. Sure, fire away, but don’t aim at me. 

We represent the Fairfield Chronicle. 

How do you do? I represent fair play, and furthermore if I am 
elected . . . 

Keep quiet. Ablo wants to ask you a few questions. 

Sorry, old boy, I thought he was introducing himself, and for the 
sake of politeness I wanted him to know . . . 

Can’t you keep quiet? 

I certainly can. Why, hack where I come from I was known as 
Silent Sid, the Slobbering Stool Pigeon, 

rd like to rsk you just a few questions, Do you know Weeks? 

Do I know Weeks? Excuse me. You wanted to ask me the question. 
You bet I do. Fifty-two of them and each one has seven days. 

No, no, J. W. Weeks. 

Oh, him. Hmm. 

(Eagerly) Do you? 

(Shaking head negatively) Yes. 
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Ablo; That*s what we wanted to find out. 

Sid; In that case I guess I can go now. 

Caul: Just a minute. 

Sid; And then I have to come back? 

Carl; Sit down. We’re not finished with you. 

Sid; Y— y— y— yes sir. 

Ablo; What do you know about Weeks? 

Sid: I-I-I- 

David; (Threateningly) Come onl 

Sid; Well, i£ I told you, you wouldn’t believe me, and then you^ think 
I’m Jylngj and even if I lied you wouldn’t believe me. 

Carl; How would you like to go down to the dungeon? 

Sid: Oh no, nol Not that! Pleasel Anything but thatl Take me to the 

movies, take me out to the ball game, but don’t fence me in. 
(Pause) 

Ablo; Let me handle him, fellows. You were going to tell us something you 
knew about Weeks. 

Sid: Oh, yes, I almost forgot. I do know something about him. 

Ablo: All right, is Weeks married, for instance? 

Sid: I— I— I— 

David: Come on! 

Sid; Well, I— I— 

Caul: What are we wasting time with him for? Let’s take him down to 

the cellar, 

Sid: Oh no, nol I can’t stand thatl It’s so— so— how do you say— dark 

down there! 

Ablo: If you answer our questions we won’t take you down there, 

Sid: Sure, sure, Anything you want, Just ask me. I’m not the kind of 

fellow who refuses anything. Why, I remember years ago, . . . 
Caul: Shut up. 

Sid: Yes, sir, 

Ablo: Was Weeks married? 

Sid: Er . . - this is strictly ontrez noose? 

Ablo: Of course. 

Sid: Also between us? 

Ablo: Sure, 

Sid: You won’t tell the other fellows? 

Ablo: You can trust me. 

Sid: And you can trust me. 

David; Well? 

Sid: Oh yes, I almost forgot. Weeks. Hmm. I don’t know. 

Carl: What? 

Sid; N — n — n — now, please. Leave us not get excited. 

Bill; We’re wasting time with him. He doesn’t know anything. 

Ablo: Wait a minute. I’ve got another question to ask him. 

Sid; May I go now? 

David; Didn’t you hear Ablo say he has another question to ask you? 
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Sid: 


Ablo: 

Sid; 

David; 

Bill: 

Ablo; 

Sid: 

Ablo; 

Sid; 

Ablo; 

Sid; 

Bill: 

Sid; 

Carl: 

David: 

Sid: 

Carl; 

Sid: 

Ablo: 

Sid: 

Ablo: 

Sid; 

Ablo; 

Carl: 

Sid; 

Ablo; 

Sid: 

Chorus; 

Sid; 


Chorus: 

Sid; 

Sound: 

Sid; 

Chorus: 

Sid: 

Ablo: 

Sid; 


Yes, but sometimes my memory is bad. Take that memory test 1 
gave you yesterday afternoon as an example. I don’t even re- 
member the name of Darius Horn. 

Just take it easy, Sid. Tell me, were you in town today? 

Wh — wh — why d — d — do you ask? 

Answer himl 
Uncross your legs! 

If you answer me you won’t be hurt, 

Oh, ril answer you. What do you want to know? 

Were you in town today? 

(Shaking head negatively) Yes. 

What did you sec? 

A horse. 

No, no. Anything interesting? 

Yes, I did. 

Oh, oh. I’m afraid of what’s coming. 

What was it? 

The horse was hoarse ... Do you want me to go to the third floor and 
report to a staff member? 

You stay right here. We’re not through with you yet. 

No, sir. 

While you were in town, did you hear anything about a . . . murder? 
A m-u-r-d-e-r? 

Just take it easy, Sid. We’re not accusing you of anything. 

Y — you must excuse my emotion. M-u-r-d-e-r. Sometimes it comes as a 
shock. 

Yes, wc know. 

How would you like to be murdered? 

No, nol Not that. You can be killed that way. 

Now think, Sid. Did you hear anything? 

Well, now that you mention It, I believe I did. 

What did you hear? 

Draw up chairs, fellows, and I’ll tell you a story that’s positively 
guaranteed to grow hair on a billiard ball. Well, I usually go into 
town for black and white ice-cream sodas which they make very 
well there except for the fact that sometimes they make them a 
leetle bit too sweet. When I got my soda today I discovered 
that . . . 

Yes, yes. 

It was a leetle bit too sweet. 

(Groans) 

Well, there I was sipping the soda through two straws (Sound of 
sipping) when suddenly . . . 

Yes, yes. 

The door opened and they walked in. Now at that time 
Who is “they”? 

Oh, you wouldn’t know them. So at first I . . . 
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Who were they? 

All right, if you insist. Both of them were prunes. 

What do you mean, “prunes'’? 

They were old and wrinkled. 

How were they dressed? 

Both wore long black dresses down at and to the heels. The dresses 
were tight around the waist and had collars around the neck. 
Each had a watch pinned on the left side . . , right above the 
. . , cr . . . ventricle. 

Do you mind telling us what you heard? 

A favor? Any time. Unfortunately, though, we’ve got to stop here 
because another test is coming up. You’ll like this one. 

What is it this time? 

First we’re going to have some field events and then a softball 

game. Okay, fellows, everybody out. 

(Running footsteps) 


Scene II 

The living room, immediately after dinner 

Hello, fcl — say, what’s happened? There’s a group in this corner, 
one over there, and another there. Aren’t you fellows talking to 
each other any more? 

Wc have to work that way. 

That’s too bad. I suppose the other two groups are too difficult to 
get along with , . . Well, if you fellows will excuse me, I think 
ril take a walk to town. 

If you don’t mind, we’d like to continue that discussion. 

You mean about what to do with Germany after the war? 

No. About that murder. 

Oh, that. Wasn’t that terrible? Why should anyone want to be 
murdered? 

That’s what we want to End out. 

Let's ask the fellows in the group over there if they know anything 
about it. 

Just a minute* We’re going to ask you. 

Why, certainly, (Raising voice) You can ask me anything you wish 
about the murder, Go ahead. Ask. This is ridiculous. Murder! 

Can’t you keep your voice down? 

(Shouting) Down? And why should I keep my voice down? I was 
once a coloratura, 

(From the other side of the room) Hey, Sid. Can you come over 
here? We’d like to ask you something. 

Sure. Til be right over. 

Oh, no, you won’t. We got you first. 

But . . . 

Here, sit down. Don’t worry about the other fellows. 
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But I can’t help feeling sorry for them. They look so lonesome, Only 
six of them together. 

Adlo: Remember what we were talking about this afternoon? 

Sid; Let’s call the other fellows over here, anti then we can all be together. 

One big, happy family, (Calling) Hey, fellows, come on over, 
Carl; Stay over there, you guys. We got him first. 

John: You had him this afternoon, didn’t you? We want a chance too. 

Sid: Who are they talking about? You, Carl? 

Carl: No, you! 

Sid: Me? 

Carl: Yes, you, 

Sid: B— b— b— but I don’t know anything about murder. Tve never prac- 

ticed it. Why should they want me? 

Ablo: If you keep your voice down and answer our questions wc won’t let 

them get you. They’re a pretty tough bunch. 

Sid: (Calling) H-e-l-pl Doctor MacKinnon!! 

Bill: Keep quiet. What arc you calling him for? 

Sip: Protection, He’s the leader of the mob at S. 

Ablo: Fellows, I think we’ll have to take him downstairs. Maybe he’ll 

answer our questions down there, 

Carl: Wc should have done that before. 

Sid: Why? 

Carl; You’ll find out soon enough. Come on, fellers. 

Ailo; Let’s give him another chance . . . Now, look, Sid. All wc want you 
to do is think. 

Sid: Trying to make it tough for me, ch? 

Ablo: This afternoon you started to tell us about something you heard in 

town today. We’d like to hear the rest of that story. 

Sid: That’s easy. But . , . 

Ablo: But, what? 

Sid: I think it would be better if you asked me questions. I’m not sure 1 

know what you want to know. 

Bill: Did you ever hear of a man by the name of Kirsch? 

Sid: Who? 

Bill; Kirsch. 

Sid: Isn’t that what you said before? 

Carl: Answer the question. 

Sid: You mean Irsch, Hirsch, Smirsch, Blrsch, Kirsch? 

Ablo: Who? 

Sid: Irsch, Hirsch, Smirsch, Birsch, Kirsch. 

Ablo: Who are they? 

Sid: All those people are one person. 

Bill: Then why do you call him Stirsch, Firsch, Nursch . . . whatever it is? 

Sid: That’s the way it sounded to me when I first heard them speaking. 

One of those names was mentioned. Which one, I don't know, 
so I give you all of them secure in the knowledge that one must 
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be correct. It’s much better than feeling insecure. I should like 
to develop this point . . . 

Ablo: You said you heard “them” speaking. Who are they? 

Sid: Why, the prunes, of course. 

Ablo: What did they say? 

Sid: Do you want to know exactly or approximately? 

Ablo: Approximately will do. 

Sid: I can tell you exactly. Why do you want to know approximately? 

Ablo: Okay. Exactly. 

Sid: Fine. Do you mind if I cross my legs. Well, there I was sipping 

my black and white ice-cream soda (Sound of sipping) wl^en my 
left antenna picked up something. At this point I’d like you to 
know tliat I am not, definitely not, an eavesd ripper. Can I help 
it if the reception was very good that day and I could hear every 
drip of conversation? 

Bill: Stop dripping and go on with the story. 

Sid: Certainly. Well, one of the old prunes said to the other old prune: 

"Did you hear about the foreign-looking man who just bought 
a farm in Fairfield?" And the other old prune said to the 
other old prune: "No. I didn’t hear about the foreign-looking 
man vvlio just bought a farm in Fairfield. Tell me about the 
foreign-looking man who just bought a farm in Fairfield.” 

Ablo; Why did you stop? Is that* all there was to the conversation? 

Sid: Gracious, no I I had to refuel. Just came up for some air. 

Bill: What did the other prune say? 

Sid; Oh, yes . . . And the other prune said: "That’s it. A foreign-looking 

man just bought a farm in Fairfield.” 

Ablo; Wasn’t anything else said? 

Sid: De seguro que si. English translation — "of course.” 

Caul: Well, go ahead. What are you waiting for? 

Sid; Bill’s eyes just (lashed red. I thought I’d wait until the light changed. 

Bill: You’d better start talking. 

Sid; Right. And then prune number 2 said to prune number i: "Do you 
know his name?" And l said to 2: "Yes. His name is , . And 
just at that crucial moment there was some disturbance in the 
ether which made the reception bad, and I couldn’t make out the 
answer. It sounded like Irsch, or Hirsch, or Smirsch, or Birsch, 
or Kirsch. So, in the interests of accuracy, I say IrschHirsch- 
SmirscliBirschKirsch, knowing that one of them must be correct. 
(Dramatically) And then . . . suddenly the door opened, and 
one of the prunes dropped her voice. Quickly, I stooped, picked it 
up, and handed it back to her, and I heard her say; "Sh , . , 
Here he comes now.” Quick like a bunny I turned around . . . like 
that. Wasn’t that fast? 

Ablo; Pretty fast. 

Sid; I was faster then ... I turned around and there he was. 

Carl: Who? 
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SiD : IrschHi rschSm irschB irschKirsch . 

Ablo: What did he look like? 

Sid: Exactly or approximately? 

Ailo: Exactly. 

Sid: I don’t remember. 

Ablo: All right. Approximately. 

Sid; That I can tell you. That I can tell you. He had close-cropped hair 

, . . a long cigar on his right check . . , 

Carl; You mean scar, 

Sid; That’s what I said . . . cigar. 

Bill: How tall was he? 

Sid: Exactly or approximately? 

Ablo: Approximately, 

Sid: I can tell you exactly. Why do you want to know approximately? 

Bill: All right, exactly. 

Sid: Well, he was about (Indicating six reet with hand) . , . five feet tall 

Ablo; Did he have an accent? 

Sid: I don’t know. He didn’t look as if he had been hurt. 

Ablo: Accent. Not accident, 

Sid: Oh, yes, Come to think of it, he did. 

Bill: What kind? 

Sid: Foreign. 

Bill: What kind of foreign accent would you say it was? 

Sid: Well, not Polish. No . . , not Polish. Not Russian. No . . . not Russian. 

Ablo: Would you say German? 

Sid; Yes, I would. That’s itl Gcrmanl Say, I'll bet you were there and 

heard the same conversation. Did you have a black and white 

ice-cream soda, too? 

Ablo: I think we ought to turn him over to the other groups. We’ll get him 

again later. Okay, Sid. You can go now, but we’ll want to sec 
you again later. 

Sid: Thanks, fellows. It was nice of you to let me listen to you. We ought 

to get together more often. See you later. 

In this crazy, frustrating, yet good-natured vein, the investigation of the 
Murder Mystery continued through the day. Most of the candidates entered 
into the spirit of the task with obvious good will. There were those, how- 
ever, who, overly serious or .short of temper, could not tolerate the con- 
tinued frustration to which they were subjected in trying to gather clues 
for the solution of the mystery. They reacted with 111 will, and in rare in- 
stances resorted to definitely sadistic treatment of junior staff members. 
These reactions, reported to the staff members during their deliberations, 
were frequently useful in rounding out the picture of a candidate or in 
confirming a hunch which up to this point had not been substantiated by a 
definite clinical observation. The skill and patience with which candidates 
queried staff members were also noted. On more than, one occasion a man 
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recruited from some investigiuive agency to do intelligence work for the 
organization showed himself to be dull and inept at this kind of work. So 
the Murder Mystery, designed in the first instance to maintain the morale 
and good spirits of the candidates during their last day at S, contributed not 
infrequently to a better understanding of them and often shed light in in- 
teresting ways upon tiieir fitness for their projected assignments. 

Athletic Events.— At two o’clock of this afternoon the candidates gathered 
at the athletic field where there was to be another test of the physical ability 
of the men under forty who had run in the Obstacle Course. Three events 
were scheduled; broad jump, high jump, and shot-put. The intention was 
to conduct the affair in the spirit of a game rather than as a serious test. 
Each man had two tries at each event, and after his scores in all three had 
been converted into a rating on our standard scale, the average rating was 
recorded on the board in the staff room in time for the final conference at 
3:30. 


Baseball Game. — Early in their stay at S, many candidates, eying the 
athletic equipment and the open fields, asked eagerly if they would have 
time for a baseball game before they left. Our answer was usually a good- 
humored, ‘'Sure, if you think you can get up a team good enough to take 
on the staff.” By the afternoon of the third day of assessment this provoca- 
tive idea had taken firm root in the minds of several of the candidates, 
partly because by this time the staff had got the candidates to agree that two 
cases of beer would be the prlvx for the winning team and partly because 
the desire of the candidates to meet the staff on equal grounds had grown 
as they were being put tlirough the paces of assessment. 

And so, after the Athletic Events, the members of the staff who were not 
serving on staff teams met the students on the playing field. Usually the ten 
best candidate players made up one team, familiarly known as the ‘‘Nylons,*’ 
and the other team, called the ‘’Ladies’ Ready-to-Wear,” was made up of 
the remaining candidates who cared to play (some preferred to umpire or 
watch or keep score) plus the staff members. With much fanfare, the game 
got under way with scoreboards and cheering sections ready, and the beer 
on icc. 

As the game progressed, the staff members took every opportunity to show 
the candidates that the competition was meant to be more frivolous than 
serious. From time to time, they threatened the candidates with bigger and 
tougher tests it they played too well. They alternately boasted about how 
well they could play and complained about their inability to catch pop flies 
because of too much paper work. They argued about every decision of the 
candidate umpire against them, but almost always gave in as soon as the 
candidates joined the dispute. They played their best most of the time (and 
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it was often necessary in order to make any showing against the candidates), 
but they took every opportunity, traditional to baseball, to make it an after- 
noon of good-natured cheering, fighting, baiting, and clowning. 

Some of the candidates caught the spirit of the staff’s behavior right away 
and joined in the fun immediately. Others took things pretty earnestly for 
a while and caught on only slowly. Still others, a small minority, took the 
game in dead seriousness, in some cases, perhaps, because that was the only 
way they could play ball, in others because they really wanted to beat the 
staff. Ac any rate, the softball game provided the candidates with one more 
opportunity to get their minor emotional loads off their chcsis and give 
something of the medicine they had taken. Most of them took great delight 
in booing and kidding, every time he dropped a foul tip, the man who had 
interviewed them in the basement on the first night. Whenever the men who 
had been the "helpers” at Construction came up to bat, they were greeted 
by hoots and catcalls and offers from the candidates to “help” them get a 
hit, and it was a great day when one of them struck out. 

For most of the candidates this was good fun, whether thc‘y were playing 
to beat the staff, giving back what they had taken for three days, or just re- 
laxing as they watched the game. And then there was the beer, for the win- 
ners and the losers, 

Interi’ogation.— In winter or inclement weather an indoor session was 
substituted for the baseball game. This meeting was known as Interrogation 
and consisted of having each man in turn take his place before the group, 
tell his cover story in a minute and a half, and then allow himself to be 
subjected to as Intense a grilling on the details of his masquerade as his as- 
sociates could give him. Their aim was to break his story and to demon- 
strate that he was not the person he claimed to be. 

This session was presided over by a member of the staff, and those staff 
members not serving on a team made it a policy to sit in on Interrogation 
to observe and report to the staff in conference anything of special interest 
in the performances of candidates either as defendants or as interrogators. 
No ratings were made in this situation, but there was ample opportunity 
to observe a man’s resourcefulness and poise as he answered questions. 
Simlliarly the fund of knowledge possessed by a candidate and his skill in 
using it in interrogating his associates revealed the extent oE his resources 
and his ability to bring them to bear upon a novel situation. 

With a quick and resourceful group, Interrogation was a lively, extremely 
interesting, and at times most rewarding session. With a dull group, of 
course, it lagged. At such times the members of the staff had to enter as 
active participants into the interrogation in order to carry it along. 

After each candidate had been grilled for five minutes, the presiding staff 
member called on his associates for a verdict as to whether he was (i) guilty 
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and should be summarily shot, (2) a suspicious character and therefore to 
be held for further questioning, or (3) innocent. 

The range of performance in Interrogation varied, as one would expect, 
from that of the painfully shy and diflident young man who could hardly 
invent a cover story at all, much less defend it, to the confident and imagi- 
native person who gave an account of himself that was rich in detail and 
carried him all over the world and in no part of which he could be tripped. 

Experimental Tests — The battery of tests employed in the assessment 
program at S was frequently changed. Before making any alterations, how- 
ever, it seemed wise to us to have some indication that a test to be added 
vi^ould be appreciably better than the test it was intended to replace. Since 
the last evening was, in a measure, a marking of time by the candidates, it 
was possible to use them for experimental purposes without in any way in- 
juring or detracting from our program of assessing them. Accordingly, all 
candidates were asked to meet in the clasvsroom at 6:30, where for an hour 
and a half they were given paper-and-pcncil tests which we were planning 
to introduce into the program. This session kept the candidates busy and 
yielded valuable information for future developments. 

Throughout the rest of the evening candidates were busy in further ques- 
tioning of stall mcinbers about the mystery, in working out their group so- 
lutions, and in preparing the report of their findings and their conclusions, 
which they would present to the whole group at ten o’clock. 

The Court.— Though the final session at which the solutions of the Murder 
Mystery were presented was presided over by a judge (played by one of 
the more humorous members of the staff), it was almost completely con- 
trolled by the candidates. 

The performance of the teams in presenting their solutions ranged from 
the most interminably dull recitation of every detail of the case, at one ex- 
treme, to a highly diverting, original, and hilarious exhibition of a denoue- 
ment as fantastic as the murder itself, at the other. Indeed, it frequendy 
happened that the more entertaining solutions made little or no pretense of 
adhering to the assumed facts. Groups of candidates sometimes dramatized 
their presentations with considerable skill, and some or all members of the 
staff were often asked to participate in the presentation of the solution be- 
cause one of the mythical principals of the murder case had been only lately 
a senior staff member, the J. W. Weeks whose belongings had been ex- 
amined by candidates during their first evening at S, and who had suddenly 
disappeared from the area. To some groups this fact seemed to involve the 
whole staff in the crime, if not as coprincipals, then at least as material 
witnesses. 

As it was worked out in practice, the Murder Mystery was not simply a 
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bit of “busywork’' designed to occupy the candidates while the staff was busy 
with its deliberations. It served as an exceedingly effective means of releasing 
the tensions which had been built up during the three strenuous days of test- 
ing. The extent to which this function was performed depended upon the 
leadership of the teams and upon the general social atmosphere created by 
the interaction of the personalities of the group members. While it may be 
presumed that all candidates developed a more or less strong wish to put 
the staff members through some of their own tests and otherwise to turn the 
tables on them, such procedures were followed by the candidates only in so 
far as the more aggressive ones were encouraged or discouraged by the 
leaders and their fellows. In most cases the mood of the group was light, 
jovial, and relaxed, although an occasional pompous, pedantic, or dis- 
gruntled candidate resisted this influence to the end. 

The tension-relieving function of the Murder Mystery was best illustrated 
by those occasions where highly aggressive candidates gave vent to their 
energies by mauling and otherwise harassing members of the junior staff in 
their attempts to extract clues, and by putting members of the senior staff 
into embarrassing positions in the final session. Here, at last, the junior staff 
members could be repaid for their behavior as helpers in G')nstruction as 
well as for the harsh interrogation of the Stress Interview. 

THE LAST MORNING 

Breakfast on the last morning was a gay meal. Humorous incidents of 
the court proceedings of the night before were recalled with laughter and 
there was much kidding among candidates and staff. High lights of their 
experiences in assessment were conjured up by candidates with the com- 
ment that they would never forget their stay at S. The affection which they 
had come to feel for each other was invariably evident, revealed, for example, 
in their proposals to meet as a group in Washington that evening or some- 
time after the war. 

The tension that had been apparent heretofore was now entirely dispelled. 
As far as we could see few candidates were really tense on that last morn- 
ing. To be sure, many of them wanted to know how they had clone cm the 
tests, but this, it seemed to us, was not so much because they were worried 
about the outcome of their assessment as it was because they were eager to 
know the significance to them as persons of our findings. Again and again 
the interviewers would be approached by candidates seeking information 
about themselves. When told that we had been forced to adopt the policy 
of not informing candidates of the conclusions we had reached, they would 
express genuine disappointment. It was regrettable, they protested, that the 
insights gained by the staff at S should not be made available to them as 
aids in deciding questions pertinent to their future. We were inclined to 
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agree with them, but we had a service job to do which made it impossible 
for us to accede to their desires. Among other reasons was the fact that we 
had to prepare for the next class arriving that afternoon. It would have been 
simple enough to tell a very superior man that he had done well in every- 
thing, but it would not have been so easy, and indeed might have been dan- 
gerous, to transmit to a mediocre candidate our impression of his chief weak- 
nesses and powers. Even had there been time, it is doubtful whether we 
would have instituted this practice. We were too aware of the fallibility of 
our assessments to want our subjects to be influenced by them in any way. 

In a less hurried and more thorough postwar assessment program, yes; but 
not at S. 

It was gratifying to have men who had resented being sent to S, and who 
on arrival had not hesitated to show resentment, end by saying that they 
had enjoyed the program and felt that they had profited by it. S was a 
“schoor^ which was designed to teach nothing, yet again and again candi- 
dates reported on their last morning that they had learned more about them- 
selves in three day.s than they had in their whole lives. Certainly S provided 
men with the opportunity to compare themselves with others and to realize 
their own effectiveness in a wide range of situations. It would have been 
strange indeed if many of them had not left S with greater self-knowledge. 
Candidates seemed to accept their new evaluation of themselves even when 
this included the recognition that in certain respects they were less able than 
they had thought. In any event it was characteristic that most of them de- 
parted with that lift in spirit which comes from insights newly gained, 

There were, of course, those who from first to last were antagonistic to 
the proceedings at S, and gained nothing from them; but, fortunately, men 
of this type, as .sullen on departure as on arrival, were not common. At first 
we rather naturally supposed they might be the rule rather than, as it turned 
out, the exception. Though they did not contribute to our well-being, we 
owe them a debt for having kept us constantly alert to the necessity of mak- 
ing the program as realistic and as interesting as possible. 

After breakfast on this last morning the members of the gtoup were as- 
sembled in the living room and given final instructions for their return to 
Washington; the Army truck which would come for them at nine would 
take them directly to headquarters, where they would change into their own 
clothes and then report at once to their respective branches, 

The continued cooperation of every man in keeping the secrets of S war 
requested. The extent to which the SLicce.ss of assessment depended upon 
men coming to it without previous knowledge was pointed out, and the 
need for security emphasized. So far as we were able to judge, our graduates 
kept our secrets very well; and to those of them who may be reading this 
we again express our thanks. 

The director usually closed his remarks in the following vein: 
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Finally, speaking for the staff, I want to say how very much wc have enjoyed 
you both individually and as a group. You have been a swell bunch witlt whom 
to work and we appreciate more than we can say the splendid cooperation you 
have given us during your stay at S. We have a job to do here, When wc first 
undertook it wc expected that it might be rather unpleasant, We could under- 
stand why many who would come here as students might dislike our program 
and even resent being subjected to it. To our surprise that has not been the 
attitude of the majority, but rather, like you, they have seemed to enjoy them- 
selves here and to have taken everything which we have had to give in the finest 
spirit and with the best sportsmanship, If we enjoy our work here and are happy 
in doing it, it is because you have all made it a pleasant task Cor us. It has been 
swell working with you and wc cannot thank you enough for your cooperation, 
By now you know that S is a great place for fantasy. As a matter of fact, we 
have so many layers of fantasy laid over us that sometimes even we on the staff 
get a little confused. There is, however, one fantasy that wc all take very 
seriously, and that is the dream that some day when this dirty business is over 
wc can have an alumni day at S with all the classes returning for the best reunion 
that was ever held anywhere. In anticipation of that clay when we shall all 
meet again there is one final assignment that I have to give you, and that is the 
task of thinking up tests with which you will test the staff when you return; 
and that is one test that you won’t fail. 

It was not uncommon for the farewell rcmark.s of the director to be re- 
sponded to by a member of the class. Sometimes this man ro.se, .spontaneously 
to speak for his classmates, but more often he had been previoiusly requested 
by them to express their appreciation of the treatment they had received. 
The spokesmen were frequently honest in admitting the skepticism and, in 
many cases, the resentment which they had felt when first informed that 
they were being sent to the country to be assessed by a group of psycholo- 
gists and psychiatrists. That experiencing assc.ssment could turn their skep- 
ticism and resentment into wholehearted enthusiasm was for members of 
the staff one of the most satisfying aspects of their work. 

After speechmaking was over, there were the more informal and personal 
farewells to be said all around, At nine the truck arrived. With last-minute 
threats of “one more test to be given’’ and shouts of "Good luck,’’ another 
class of candidates was driven away from S. It was difficult to believe that 
this was the same group which had arrived four clays before. 



Chapter V 

ASSESSMENT AT S: FORMULATIONS AND RATINGS 


la the last chapters we have described the many gears and wheels, axles 
and cams, making up the complex machine that was S, as well as the prin- 
ciples governing its complex operations. Now let us see it manufacturing its 
product, the final assessment formulation. To do this we must view the 
operation from behind the scenes, having so far observed it from the stand- 
point of the candidates. 


THE WORK OF THE STAFF 

The picture of assessment in operation would not be complete if the ac- 
count of the procedures that filled the time of the candidates was not com- 
plemented by a description of the activities of the staff. For the members of 
the staff were more than mere testers and scorers with functions limited to 
those implied in the description of the tests. They Were, as has already been 
pointed out, a part of the situation itself, components of the differentiated 
social^ world with which each candidate had to deal, Also— and this is the 
function that concerns us here— their clinical judgments were the chief 
means of arriving at the final conclusions. It was not only that their observa- 
tions and evaluations provided the major portion of the data to be consid- 
ered. The data in each case had to be synthesized into a coherent formula- 
tion of the personality which could serve as a basis for specific predictions. 
To suppose that useful evaluations could be reached by an automatic sum- 
mation of scores on a number of selected aspects of behavior would have 
been contrary to our basic assumptions; hence the principal activity of the 
staff consisted of a series of processes the aim of which was to integrate the 
findings on all single procedures* 

The total task may be analyzed for convenience into three component 
functions: (i) obtaining data (observation and scoring tests); (2) form- 
ing a unified conception of the personality (diagnosis); (3) estimat- 
ing the probable level of future performances (prognosis). While from 
the start of each three-day period of assessment most of the work of the staff 
involved all three functions, with passage of time and accumulation of 
data, diagnosis and prognosis came increasingly to the fore, to be given final 
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formulation in the staff conference. As the following descriptions of 
procedures will show, the main part of the diagnostic and prognostic work 
was carried out by the stall functioning as a group. 

In order to formalize to some extent the distribution of these functions, 
the assessors were divided into senior and junior stall on the basis of age, 
psychological training, and practical experience. Both the giving and the 
scoring of standardized tests were left to the junior staff, wliilc interviewing 
was confined to the senior staff’s sphere of activity. Both senior and junior 
staff members participated in observing, in rating, in organizing the find- 
ings, and in making the final evaluations. Because of their knowledge of 
the interview material, however, the members of the more experienced 
senior staff were better equipped to arrive at a formulation of each personal- 
ity, and, consequently, to their lot fell the greater share of the responsibility 
for the final decisions. 

The staff was divided into teams usually composed of two seniors and one 
junior, each team being assigned one subgroup of five to seven candidates. 
The seniors between them interviewed all the members of their subgroup 
and conducted most of the situations; the junior member of each team in- 
terpreted die bulk of the projective material, and, when necessary, admin- 
istered certain special individual tests. Otherwise the functions of all team 
members were the same; individually and then collectively, their aim was 
to develop a well-founded conception of each personality in the subgroup 
assigned to them. The composition of the staff teams was varied from time 
to time, so that in due course everyone had a chance to function on a team 
with each of the other members of the staff. 

The day-by-day activities of the staff as well as those of the candidates were 
regulated by a strict schedule. With a multitude of events pressed into the 
short space of a day, with procedures being added and changed periodically, 
and with the frequent necessity for special tests to be given to individual 
candidates, the task of scheduling— done each evening for the next day— 
was exacting and laborious. It was, however, a prerequisite for the smooth 
running of the program, and the neat individual schedules contributed not 
a little to the impression that this was a serious, well-regulated enterprise. 

The first phase of the staff work consisted largely in acquiring data by 
observing the candidates in individual and group situations and making in- 
dependent ratings of each candidate on all the variables involved. For this 
purpose the six-point scale, as described in Chapter z, was used. The frame 
of reference for these ratings, after the first month or two, was tlie “ghost 
population” of S, that Is, all candidates who had been a.sscsscd to date. And 
in order to counteract the common tendency to confine ratings to one seg- 
ment of the scale, the staff was instructed to keep in mind a near-normal 
distribution curve, the frequency of ratings in each category being ideally 
as follows: Very Inferior (o)— 7 per cent; Inferior (i)— 18 per cent; Low 
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Average (2)“25 per cent; High Average (3)— 25 per cent; Superior (4)— 
18 per cent; Very Superior (5)— 7 per cent. By combining the two lower 
and two upper categories, a four-class scale was obtained with 25 per cent 
of the population theoretically in each class. This distribution, however, was 
barely approximated in actual practice. 

In rating the situations, it was found that finer discriminations were both 
natural and feasible, and, consequently, the addition of a plus or of a minus 
to one of the six numbers on the scale became common practice. Since the 
ratings 0^ and 5-!- were, in fact, never used, the stafi members were operat- 
ing most of the time with a sixteen-point scale. 

The different steps in the scale for each variable were not defined, as they 
might have been, by listing the forms of behavior illustrative of each cate- 
gory. Consequently, the staff members were not forced to limit themselves 
to the observation of behavior which could be immediately translated into 
ratings of variables, but were free to keep their eyes open for any actions 
which might he indicative of significant individual traits, This freedom, 
however, had certain disadvantages: it was responsible for certain confusions 
and inconsistencies. On the one hand, it was desirable to rate each perform- 
ance of a candidate in its own right, independent of his performance in 
other situations, and the assessors consciously attempted to do this. On the 
other hand, as they followed a candidate from situation to situation, famil- 
iarized themselves with the scores he had made on other tests, and observed 
him in informal contacts, their growing understanding of him necessarily 
influenced their perception and interpretation of the more subtle behavioral 
and expressive signs, and to that extent also influenced their ratings. Hence 
the scores in the situations scheduled late in the program were influenced 
by the cumulative evidence, rather than solely by the performance 
in the single test. This was the logical outcome of the attempt to arrive at 
a maximally comprehensive and meaningful personality picture. The goal 
required that all data on the candidate be available to those whose job it 
was to study him and that all facts he examined in relation to each other. 
Consequently, the ratings were not dependable indicators of effectiveness in 
specific situations. 

The ratings in situations were made by each team member independently, 
although communication between team members during the course of the 
test was not forbidden; but as soon as the five or more candidates in one 
subgroup had completed a situation— say, Construction — the team observers 
met in conference with the sheets bearing their own ratings, one member 
bringing with him also a blank sheet on which to record final pooled scores. 
This man usually would act as chairman of the group. Frequently, though 
not always, the senior or the mo.st dominant staff member assumed the role. 
It was important who took it, for the personality of the chairman may well 
have been a significant determinant of the final combined rating. 
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Ideally this meeting of the team took place immediately after each situ- 
ational test, though sometimes the press of scheduled appointments forced 
a postponement of it until later in the day. The purpose of the meeting was 
to replace the several sets of ratings given to each candidate by one set of 
ratings which would be recorded as the final evaluation of the various as- 
pects of his performance in the given situation. This set of ratings was to 
represent the best judgment of the whole team— ideally each member should 
be willing to subscribe to it. With this aim in view, the disagreements 
among raters— which we shall see later were not great — were not dealt with 
by merely averaging the individual scores but rather were resolved by means 
of discussion. Sometimes disagreements were due to discrepancies in the 
perceived actions: with several people to be watched simultaneously, each 
individual observer was bound to miss some significant details. Such dis- 
agreements were easily resolved when the observations were recalled and 
pooled, Differences in interpretation and evaluation of observed behavior 
presented more serious obstacles, but rarely such as to require resort to a 
statistical average to get agreement, While it is true that occasionally the 
consensus achieved was a mere compromise, determined very frequently 
by factors in the raters’ personalities, it is no less true that in many cases 
the discussions resulted in an interpretation of the candidate’s behavior that 
was better documented, more detailed, and more consistent than the indi- 
vidual interpretations had been, and which was therefore genuinely accepted 
by all members of the team. In all cases the exchange of opinions served to 
inform each observer of the criteria of evaluation used by the others and 
thus contributed to a gradual formation of a frame of reference shared by 
the whole team. Thus the function of the rating conferences went far be- 
yond that of merely obtaining one set of ratings. Frequently it led to the 
team's arriving, in a first approximation, at a conception of a candidate’s 
personality, a conception which was to be checked and corrected through 
further observations. 

The bulk of the observations obtained during assessment was assimilated 
in this way. In only a few of the nonstandardized procedures were the rat- 
ings assigned by a single observer (Interview, Post-Stress, OWI, and Man- 
churia), or obtained by merely averaging the ratings given by two or more 
observers (Obstacle Course, Rebate). The number of rating conferences 
varied with the number of currently used situational tests, but it never fell 
below five for each staff team. Thus these conferences served to keep the 
team members in constant touch with each other during the three-day diag- 
nostic period. 

Not all conferences, however, were devoted to the determination ot rat- 
ings. One procedure, Improvisations, designed to test hypotheses about each 
personality, called for a different type of group work, both for its prepara- 
tion and for the evaluation of its results. The candidates first had to be cast 



Assessment at S: Formulations and Ratings 207 

in the roles that would be maximally revealing and that could conceivably 
confirm or disprove definite suppositions about them, This was done in a 
meeting that took place a few hours before Improvisations was scheduled. 
Since for Improvisations the class was divided into two sections only, the 
three or four stall teams were also divided into two groups, each to devise 
plots for one section. In preparation for this meeting the staff member who 
was to conduct Improvisations prepared a list of the cover stories invented 
by the candidates, as well as of their postwar plans, both of which had been 
written out by the candidates earlier in the day. At the start of the meeting 
the interviewers and other team members raised questions that they wanted 
to have answered about each candidate. Some of these questions were quite 
general (e.g., how skillful were a candidate’s social relations), but more fre- 
quently they were rather specific, having been formulated on the basis of 
previous observations in the light of the particular requirements of the pro- 
jected assignment. The questions might involve the candidate’s handling of 
inferiors or superiors, his tact and resourcefulness, his proneness to guilt 
feelings, his tendency to blame others, or his reaction to such specific accusa- 
tions as that of dishonesty or alcoholism, or his attitude toward a particular 
group, such as Orientals. 

After the questions had been defined, the creation of appropriate situations 
was the task of the assembled staff members, and the nature of the ensuing 
performances was such as to win for this meeting the nickname of Brain- 
storms. The problems to be solved were by no means easy; they required a 
simultaneous consideration of a multiplicity of factors. For each candidate 
both a suitable situation and a suitable partner had to be found, and the 
situation had to be such as to provide an opportunity for exposing the cru- 
cial dispositions in each of the two participants, In addition, the cover stories 
of both had to be considered. Not infrequently we would select partners 
whose personal characteristics and problems were mutually complementary 
— say, a domineering man whose tact was the point at issue and a meek, un- 
assuming candidate whose ability to stand up for his rights was doubted- 
only to find that the gap between their professed social roles made it seem 
almost impossible to bring them together in a plausible situation. For rea- 
sons such as these, creative imagination, as well as a knowledge of a wide 
range of vocational and social situations, was at a premium in Brainstorms. 
Eventually the seeming impasses would be broken, sometimes through a 
laborious trial-and-error process, sometimes through a sudden happy idea 
that led to a perfect solution. As the staff gained experience with Improvi- 
sations its members accumulated a repertoire of plots that had proved suc- 
cessful in the past and drew on it freely. Even with this help, however. 
Brainstorms continued to tax the staff’s ingenuity and remained to the end 
a challenging and highly rewarding task. The largest share of this work 
fell to the chairman of Improvisations. After the plots had been invented, 
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it was he who wrote out the stage settings in their final form and decided 
on their sequence and on the exact wording to be used in presenting each 
situation to the candidates, 

Braiiistorins was not only a necessary preliminary to Improvisations and 
a welcome outlet for the creative fantasies of the stafi; the necessity to form- 
ulate the essential questions to be asked about a candidate forced the inter- 
viewers and the situationists to review at this time all material so far ob- 
tained, and to formulate problems on points about which they were still un- 
clear or in doubt, as well as on those which might possibly represent sources 
of potential difficulties. Furthermore, in the course of Brainstorms, the plac- 
ing of the candidate tentatively in various imaginary situations, with various 
partners, and the consideration of how he would act in each case, helped to 
sharpen and conceptualize these problems. 

The meeting of the stall that followed immediately after Improvisations 
provided an opportunity for deciding whcdier or not these hypotheses had 
been verified. It was in this highly informal session that the most animated 
and productive discussions of individual candidates took place. There were 
no ratings to attend to; an attempt to rate personality variables revealed by 
the performances in Improvisations was discarded after a brief trial Since 
all improvisations were different, the comparison of candidates and traits 
implied in rating was not feasible; furthermore, it was felt that the mere 
listening to each plot as it was developed by the “actors,” and its subsequent 
discussion by the group resulted in more insight, In order not to make the 
performers too self-conscious, the staff members refrained from taking notes, 
but invariably they left Improvisations with a wealth of impressions which 
they were eager to exchange. The candidates were discussed one by one, 
iheir performances reviewed and evaluated, and conclusions drawn without 
any formal procedure. The discussions often transcended the immediate oc- 
casion, ranging freely over the material previously obtained through other 
procedures. The team members had a chance to learn what impressions 
their subjects had made on the other staff members who witnessed their 
improvisations. This intensive discussion of individual candidates, coming 
toward the end of the assessment period, and being highly productive of in- 
sight, was one of the most important single steps in forming the final 
opinions of the staff. Not infrequently the preliminary decision to pass or 
to fail a candidate was informally reached during this session. 

The regular meetings of the staff team — such as the rating conferences, 
Brainstorms, and Post-Improvisation— provided set occasions for group dis- 
cussions, But exchanges of observations and opinions among the team mem- 
bers were not limited to these occasions. There were many casual contacts 
and conferences of two or more team members arranged for a special pur- 
pose. The interviewer, after having seen a candidate, often told the other 
team members of the essential findings of the Interview. On other occasions 
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he met with the team member who had interpreted the projective material 
of his interviewee) and together they went over the conclusions, comparing 
them with the data obtained from the Interview. Special procedures de- 
signed to deal with language handicaps, medical problems, and other par- 
ticulars also called for discussion, cither with team members or with other 
members of the staff. The person who gave the candidate an individual in- 
telligence test or the Rorschach test, or the physician who obtained a de- 
tailed medical history or gave a physical examination imparted his observa- 
tions and conclusions to the interviewer as well as to the others. Similarly, 
the results of tests of special skills— the Teaching Test, tests of ability to write 
propaganda and others— were at least briefly discussed with those who had 
witnessed or scored them. 

All these data were brought together in the last meeting of the staff team 
which took place on the morning of the third day. The function of this 
meeting was to sum up the findings of assessment and arrive at a prelim- 
inary decision about each candidate which would later be presented to the 
entire staff in conference. This decision was not always easily reached, nor 
was it always felt to be satisfactory. At times the material obtained on the 
candidate did not seem to arrange itself into any meaningful pattern, and 
the team had the uncomfortable feeling that, although they knew a great 
deal about the man, they had no real understanding of him. This, however, 
was a rather infrequent occurrence. Usually the personality picture was 
fairly clear in the minds of the team members, and they were relatively con- 
fident of its accuracy. Yet often there was no equal clarity in their ideas as 
to how such a person would fit into a job about the requirements of which 
little was known, and the decision remained a difflcult one. Occasionally the 
team was so much in doubt that its decision was merely tentative, in which 
case the members would prepare to present to the staff conference the 
reasons both for and against it, and hope for further clarification. 

After all cases had been discussed in this way the work of writing the 
personality sketches was apportioned. The following is a typical example of 
the final product. 

This competent, energetic, self-confident Sergeant is very well qualified for 
his assignment by his ability, personality, and background. He is a determined, 
clear-thinking person who has well-defined values and goals which he pursues 
with unswerving persistence, fully utilizing his capacity for hard work. In spite 
of his pronounced tendency toward self-reliance and independence which, com- 
bined with his rejection of indiscriminate gregariousness, often leads to blunt- 
ness in social relations, he is essentially a person of good will, is^ frank, sym- 
pathetic, sincere, and a good mixer. While his brusqueness and independence 
may alienate people upon first contact, over a longer period of time the student 
is likely to win and hold both the respect and the affection of his colleagues. 
These traits, together with his readiness to take responsibilities for others, to 
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solve problems, and to make decisions, qiialil'y the candidate (or a position of 
leadership higher than one that would he coinpalible with his rank. 

Son of a successful attorney-at-law, the candidate grew up in Oregon and 
Wisconsin and from an early age developed a great love for outdoor life, becom- 
ing proficient in mountain climbing, skiing, riding, and swimming, He was 
always a good student in school, sociable and active in a variety of extracurricular 
pursuits, Very close to both parents, and admiring his father's character and 
achievements, he decided to follow him in the legal profession, and obtained his 
degree from the University of Missouri in 1941. Expecting to be drafted, he 
postponed going into practice, and took a job with the U,b, Department of 
Justice. He enjoyed this work greatly, and in the course of it has acquired some 
experience in questioning Chinese and Japanese. Inducted into the Army in 1943, 
he went through basic training and a radio school and has worked as radio 
instructor for the last two years. In spite of slow promotion, he has adjusted 
well to this situation, has enjoyed teaching, for which he oblaitted the highest 
ratings, and has utilized his free time for extensive reading in the field of law 
and social science. He wants an overseas assignment because he feels that he 
should do more for the war effort and feels capable of handling a strenuous and 
responsible mission. Although the candidate's strong desire to do well makes him 
nervous and tense in test situations, or in beginning a new type of work, in- 
creasing familiarity with the situation quickly dissolves these tensions; the 
student is well integrated emotionally and has no disturbing conflicts or fears; 
while he does not seek danger he is willing to take any risks that the assignment 
might involve. 

This candidate was very highly motivated for all of the situations at S. He 
entered into the assignments enthusiastically and exerted himself to the utmost 
in order to achieve a successful solution of his group’s problems. Possessing a 
good measure of forcefulness and self-asscrtivcness, he was usually the first to 
make any bid for leadership. Only the lack of suflicient ingenuity in field prob- 
lems prevented him from carrying out this role with distinction. He is adaptable 
and flexible — attributes which should stand him in good stead in acquiring the 
leadership techniques and fundamental knowledge necessary to handle his pro- 
jected assignment effectively. 

He has a strong desire to plan and carry out tasks on the basis of his own 
ideas. As a result, he tends to be somewhat abrupt with others who have different 
ideas and he is very likely to overlook their point of view in favor of his own. 
However, he has sufficient insight into himself so that this characteristic rarely 
becomes so dominant as to interfere markedly with his social relations, Further- 
more, his good will, warmth, and sympathetic understanding of others become 
more obvious as time goes on. He should therefore wear well with any group 
with which he is associated over a long period of time. 

In situations which he regarded as critical tests of his abilities, his tensions 
expressed themselves in profuse sweating and quivering limbs. He was aware of 
his uneasiness and discomfiture but controlled himself so well that he never 
became upset and never permitted his emotionality to interfere with the work 
at hand. 

He is highly recommended for his proposed assignment overseas. 
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The first part o£ each sketch was written by the interviewer of the candi- 
date. It was based largely, though not exclusively, on the Interview material 
and contained the essential formulations of the personality structure. Since 
the reports were designed for the use of the administrative officers, facts and 
concepts that could convey no clear meaning to the layman were omitted, 
even though they had been instrumental in arriving at the conclusions 
presented in the report. The second part of the sketch, which described 
and evaluated the candidate’s behavior at S, was written by one of the 
situationists. Although this latter account was held on a more concrete level, 
it still presented ample opportunities for the writer to bring out the signifi- 
cant patterns of behavior which could be expected to repeat themselves in 
the future. Each situationist wrote on those candidates about whom he 
had gathered the most material, or into whom he felt he had the greatest 
insight. 

The personality sketch which in the early days of S was limited to one 
short paragraph, grew in time to considerable dimensions, and came to be 
considered, by both the staff and the administrative officers, as the most 
essential part of the S report. While it was expected to follow a certain 
general outline in all cases, and to cover certain areas, including the subject s 
life history and his performance at S, this sketch permitted the writer 
enough freedom to select and organize his material so that the most 
significant features of each case could be brought out. Of course it had its 
shortcomings. To the extent to which such a picture was interpretive, it 
reflected not only the configuration of the candidate’s personality but also 
the writer’s preconceptions as to what action patterns are generally sig- 
nificant, or in what areas of life and behavior they are most clearly revealed. 
This subjective factor was to be checked later by the collective effort of the 
group in the staff conference. 

Through the rest of the third morning and early afternoon the team mem- 
bers were engaged in writing their reports, while staff members who were 
not on teams completed the administration and scoring of tests. The set of 
ratings which was most eagerly awaited was that based on the results of 
the Sociometric. Since the factor of Social Relations was important in our 
decision, all of us were anxious to discover whether our own estimates of 
this variable would be confirmed or contradicted by the judgment of the 
man’s colleagues. An additional source of information on this point was 
the set of personality sketches, written by the candidates about each other, 
which the interviewers read and rated some time during this third day. 
Although the understanding of other people revealed in these sketches was 
measured by the yardstick of our own already formed conceptions of the 
persons described, the sketches not infrequently contributed pertinent in- 
formation by reporting behavior that had never been observed by the staff. 
Occasionally these last-minute additions threw a new light on a candidate s 
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personality and made the staff team change the conclusions it had reached 
in the morning. This possibility made it necessary for the two team mem- 
bers working on the same report to keep in close touch through the period 
o£ writing. Usually the interviewer and the situalionist found time to read 
and criticize each other’s reports before the staff conference, and if necessary 
change them so as to make the joint product maximally consistent and 
meaningful. The last part of the personality sketch, which stated the pre- 
liminary decision as to whether the candidate was fitted for his proposed 
assignment, was often written by the two in conjunction. 

THE STAFF CONFERENCE 

The staff conference which began in midafternoon and frequently lasted 
late into the night was the culmination of the assessment program, and an 
epitome of the group work of the staff. In this last step of assessment the 
cases of all candidates were presented, the evaluations criticivxd, and the 
dispositions decided on. At this regularly recurring meeting, in the presenta- 
tion of individual cases and the thorough discussion of all differences of 
opinion, the staff members gained an intimate knowledge of each other’s 
viewpoints and biases, learned to appreciate each assessor’s special talents 
and to deal with his weaknesses, and were progressively wehled into an 
efficiently functioning working unit. 

The keynotes of the conference, which was held under the chairmanship 
of the director, were informality and dispatch, The presentation of each 
case was begun by the interviewer, who read first a description of the 
candidate’s proposed assignment and a statement of the qualifications re- 
quired for it, as formulated by the branch. He then read his part of the 
personality sketch. The situationist followed by reading his part as well 
as the recommendations made by the staff team. After that the report was 
open for discussion. It was up to the whole group now to see that no un- 
warranted generalizations were permitted to remain and no relevant con- 
tradicting observations were neglected. Criticism, freely expressed, was 
abundant and widely varied. The report might be criticized on such essential 
points as failure to take account of some significant features of the candi- 
date’s behavior or of the requirements of the job, or criticized for lack of 
integration and consistency, for inclusion of irrelevant or undesirable ma- 
terial, or for such minor matters as grammar and style. 

This barrage of comment, however, was only the first step in the work 
of the group. The purpose of the meeting was to arrive at an optimal char- 
acterization and evaluation of the candidate, and unless the report as 
presented was felt by the group to be completely adequate, it had to be 
made so through the cooperative effort of the group. While in the majority 
of cases the report was accepted with minor changes only, some problematic 
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cases were reviewed and reworked in great detail. This involved another 
pooling of observations and interpretations. The team presented the material 
not explicitly mentioned in the personality sketch, and other members of 
the staff contributed their own impressions of the candidate obtained in 
special examinations or in casual contacts. Occasionally when the stafi 
learned that certain pertinent information had not been obtained or was not 
clear, some staff member was delegated to obtain it from the candidate 
during the conference itself. At other times reports came to the conference 
on some striking behavior that had just been displayed by the candidate on 
the athletic field, or in the investigation of the Murder. 

As would be expected, the major problem in the difficult cases was the 
final decision. Frequently the personality sketch as such presented a con- 
vincing picture and brought forth no objections, but the opinions as to how 
such a person would adapt overseas or fit into his particular assignment 
would still be uncertain or even strongly divided. In such cases the dis- 
cussions were continued until a decision was reached that was felt by all, oi 
at least by a large majority, to be satisfactory. The candidate could be cither 
approved or failed for his proposed assignment, but neither approval nor 
failure was necessarily absolute; he might be failed with an indication that 
he would be approved for a different type of assignment, or he might be 
approved for some functions or locations demanded by the assignment but 
not for others. A compromise solution was the conditional approval, or the 
so-called "red flag." In this case the candidate was approved provided he 
successfully completed an OSS school and obtained a favorable report frorn 
the instructors therein. This, however, was not a solution for all doubtful 
cases; it was reserved for those where it could be expected that the sojourn 
at an OSS school would bring forth more evidence on the particular points 
-such as the candidate’s social relations, or special abilities— that made us 
doubt his fitness. In making such conditional recommendations the staff 
drew on the information about the activities and life at the OSS schools 
acquired by the several staff members who had attended them for that 
purpose. Whatever the final recommendation, the report was not con- 
sidered satisfactory if it did not also contain more specific recomrncndations 
about the candidate’s best possible utilization, or at least provide a basis 
for such decisions through a clear presentation of his assets and liabilities. 
If the decision finally reached, or the discussions preceding it, necessitated 
changes in the original report, the authors had to rewrite it in part; it the 
changes were extensive, the new version would be read to the staff during 

the last part of the conference. .u c t 

With the decision once made, the group proceeded to making the fina 
ratings on the main variables. This task was greatly facilitated by the use of 
a rating board on which had been previously recorded the scores given to 
all the candidates in all the procedures they had undergone. This device. 
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which tunctioned iKs a running record c»f ilic candid ate s [)rogrcss through S 
and which was consulted constantly hy the staff throughout the assessment 
periodj merits a detailed description. The candidates’ cover names were 
arranged alphabetically in the lirst columiij ami to the right td each name 
were eleven large vertical coliunus representing the eleven chief variables 
measured: Motivation for Assignment, Energy and Iniiiative, Effective In- 
telligence, Emotional Stability, ScKial Relations, Leadership, Physical Abil- 
ity, Security, Observing and Reporting, Propaganda Skills, and Integrity. 
Most of these large columns were made up of several subcolumns, each of 
which represented a situation or test from which a rating on that chief 
variable could be obtained. A horizontal row was devoted to each candidate. 
This, in turn, was divided into six horizontal subrows representing the 
points on the six-point rating scale, zero being at the bottom anrl five at the 
top. As the teams determined the final rating on each variable in each pro- 
cedure for each candidate, it was recorded on this master chart hy sticking 
a thumbtack into the proper square. Blue thumbtacks were used fur ratings 
below average and red ones for those above average, so that it was po.ssible 
at a quick glance to estimate roughly the level of achievement of ihe candi- 
date for each of the major variables. (Sec picture facing page 213.) 

When deciding on the final rating of the variables the confercace members 
turned to the board and consulted the thumbtacks, while one person checked 
them against a more detailed record of all ratings. (Scores on subtests, as 
well as pluses and minuses, wore omitted on tlic board.) Whenever the 
ratings of one variable in various tests were fairly close to each other and 
there were no obvious reasons for questioning their validity, the final rating 
could be derived by a quick inspection, by averaging at a glance, as it were, 
When the outcome of such averaging was doubtful, pluses and minuses in 
the more detailed record were consulted. A wide spread of ratings or a dis- 
crepancy between the ratings and the descriptions contained in the person- 
ality sketch called for a discussion of the reasons for this and for a decision 
as to which data should be given the greater weight. Sometimes a wide vari- 
ation in ratings resulted from the fact that some of the tests were inappro- 
priate for a candidate of a given background. Or it may have arisen from a 
language handicap or from variations of motivation from one test to another. 
Such factors could be evaluated in relation to the candidate’s jol) and could be 
allowed for in deciding upon the final ratings. In other cases the disparity 
of ratings seemed to indicate true differences between variables or between 
various components of a single variable. A man’s tlicorctical intelligence, 
say, could be high, but his mechanical or social intelligence low. Occasionally 
a candidate’s war motivation was found to be high, but his motivation for 
his specific assignment low, or vice versa. Such differences were recorded 
on the rating sheet (see page 215) by crossing out those components of the 
variable (the subvariable listed under the general variable) which were 
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Even when, no striking disparities were found in the separate ratings of a 
variable, the derivation of the final rating dc[)arted from a mere averaging 
of all ratings because of the differential weighting of the data. This weight- 
ing was necessary, first because we did not ascribe equal value to all tests 
of a variable, and, second, because some tests had a greater pertinence for 
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a given job than did others. In certain traits, notably Emotional Stability, 
the opinion of the interviewer was weighted more heavily than the ratings 
given in situations, In Social Relations, on the other hand, the actual be- 
havior at S was considered better evidence than indirect facts obtained in 
the Interview, The Obstacle Course was corisSidercd to be by far the most 
revealing test of Physical Ability, and unless there was great disparity be- 
tween performance on this course and in other situations, the rating of 
the former was considered final. When the candidate's job required definite 
abilities and skills, such as theoretical thinking, skill in analyzing intelli- 
gence material, or in writing propaganda, wc tended to give greater weight 
to the tests that directly involved such capacities than to other items of the 
battery. 

Such weighting and manipulating of scores was not done lightly. After 
all, a good many man-hours of a trained stall had gone into the making of 
each average figure, Each constituent rating was conscientiously corrected 
for the inevitable artificiality of the conditions under which it was made. 
Only by viewing the ratings in the light of everything else that was known 
about the individual could such allovvanccs be made. There were two major 
sources of corrective facts: the psycliiatric interview and die cross-fire of 
critical judgments made by the assembled slalT members who, recalling 
this, that, and the other episode, tried to reconcile apparent discrepancies. 
Sometimes, following such an interchange, the rating stood and the written 
report was amended accordingly, Sometimes, if there was a convincing 
hypothesis as to why the ratings were probably in error, the written report 
was accepted and the ratings were changed. Much more often, neither 
needed substantial modification. 

In short, the staff at S was faced with the problem of making a recom- 
mendation based upon an over-all picture of an individual who must func- 
tion not just as leader, or just as mechanic, or just as propagandist, but also 
as a man. Hence all necessary pains were taken to arrive at an evaluation 
which had psychological self-consistcncy in spite of apparent contradictions, 
and which conformed to all the facts as accurately as the staff could under- 
stand them. 

Such a procedure may seem not only to commit the halo fallacy, but 
actually to glory in it. If by 'lialo” is meant the acceptance of the intcr- 
consistency of observed behaviors in the light of all that is known about 
the individual, the staff at S gladly subscribed to the '^fallacy"; and if by 
avoidance of '‘halo" is meant the insistence upon the equal validity of each 
Independent observation, the staff at S would feel that the avoidance of “halo 
fallacy" is itself a fallacy. 

Another departure from strict averaging was made in an effort to com- 
pensate for the fact that in any such procedure which entails combining 
scores the final resultants tend to regress toward the mean. A consequence 
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of this is that the extreme high and low grades arc not used so often as 
demanded by the theoretical curve mentioned above. To correct for this 
tendency the group adopted conventions to force the final grade into the 
extreme categories whenever possible, For example, if all raters gave a 
4 or 4+ the final grade would be pushed to 5— or 5. Similarly, agreement 
on i^s would result in a final grade of 0+ or o. 

After the final ratings of the first ten variables had been decided on, the 
interviewer commented briefly upon the score he had given the candidate 
on Integrity. This was necessarily a rather impressionistic estimate based 
almost entirely upon material obtained in the Interview and consequently 
was rarely contested by others, for lack of relevant information. After that 
each staff member independently rated the candidate on his fitness for his 
assignment, writing the figure on a slip of paper. Then each man announced 
his decision and the final job-fitness rating was derived by averaging. If 
anyone made a stand in defense of a different rating, another discussion 
followed, terminating either in agreement or in a vote. In similar fashion 
an over-all rating was arrived at, representing an estimate of the total 
potentialities of the candidates for meeting the challenges of life— an 
exceedingly vague and difficult concept to define. 

The rest of the procedure consisted in. filling out various printed forms 
for the candidate which, together with the personality sketch and the ratings, 
made up the S report. In the last months of assessment this involved check- 
ing one of the following possible decisions: Not Recommended, Doubtful, 
Recommended with Qualifications, Recommended, Highly Recommended. 
Although a job-fitness rating as low as i did not necessarily preclude a 
candidate from being considered suitable, scarcely anyone was recommended 
with a score below 2. The job-fitness rating of 4 or 5 meant high recom- 
mendation. A similar scale (not recommended to highly recommended) was 
used to indicate our estimate of the candidate’s fitness for work (i) at a rear 
base, (ii) at an advanced base, and (iii) at the front or behind the enemy 
lines; of his fitness for (i) higher, (ii) middle, and (iii) lower level of 
authority and responsibility; and of his fitness for different types of assign- 
ments, such as administrator, intelligence officer, operational agent, and 
so forth, These ratings, in conjunction with the personality sketch, were an 
attempt on our part to assist in an adequate placement of the candidate, 
in case it should be necessary, as it often was, to change his assignment. 
Because all pertinent data had been thoroughly discussed before, seldom 
were there difficulties or disagreements in filling out these forms. When 
they were completed, the reports were taken to the secretaries, who typed 
them, after which they were carefully proofread and checked by members 
of the junior staff for errors and inconsistencies. 

This step-by-step description of the conference proceedings can give only 
an inadequate idea of the vigor and vitality which often marked these meet- 
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ings. Formality was absent, free expression reigned, yet the often heated 
discussions never became truly violent or bitter, in spite c;f the great per- 
sonal involvement of the participants. Behind the uninhibited arguments was 
an attitude of mutual appreciation wliich facilitated acceptance of criticism 
and enabled everyone to join in the frequent outbursts of hilarity, even he, 
if not especially he, who was the butt of a joke. The sustained enthusiasm 
was due in large part to the staff’s great interest in the candidates and their 
destinies. The staff members who had observed a given man most closely, 
particularly the author of the personality sketch, not infrequently developed 
a strong sympathy (though occasionally an antipathy) for their subjects and 
became to some extent, however flcetingly, identified with them. It was a 
commonly recognized phenomenon, and a subject of some amusement, that 
the interviewer frequently became the spokesman of ‘*his‘’ candidate, de- 
fending the more favorable interpretation of his behavior and trying to 
secure higher scores for him. This tendency was usually corrected by the 
counteracting weight of the rest of the staff, most of whom were well aware 
of this bias, both in others and in themselves. The appearance at S of candi- 
dates outstanding in achievement, ability, and personality — of whom we 
had many — contributed greatly to the zest of the staff conferences. The 
sketches of their characters were the peaks of the meeting, and at times it 
took a great deal of both serious and humorous mutual warning about the 
operation of partiality to restrain our enthusiasm and to keep the evaluation 
of the outstanding candidates within the limits of justifiable praise. The 
borderline cases and those presenting subtle and intricate [jroblems were 
especially challenging and very apt to be productive of stimulating discus- 
sions and new insights. 

It may be accepted as evidence of the effectiveness of our mode of collec- 
tive action that such a relatively large number of persons as met in staff 
conference succeeded in attaining agreement through discussion. There was 
a decided sentiment against arriving at crucial decisions by a mechanical 
counting of votes, and this device was used only as the last resource. A 
necessary condition for the effectiveness of this method of discussion was 
the chairman’s democratic mode of leadership. The director of S, acting as 
chairman, encouraged the free expression of opinion by giving earnest con- 
sideration to all points made. While he often ttiok a clefiiutc stand himself, 
he was at all times genuinely intent on making the best judgment of the 
group instrumental in each single decision. Occasionally the discussion got 
out of hand, and intervention was required to bring the clis[)utants back to 
the topic and to a satisfactory conclusion; but, in accomplishing this, the 
chairman was supported by the unanimous realization that many critical 
decisions had to be made within a limited period of time. 

After the staff conference was over, the director of S read and signed all 
typed reports. These were delivered early next morning at headquarters In 
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Washington, but since they might not reach the administrative officer who 
would act on them until after the candidates had reported back, the director 
had to call each branch representative on the telephone to notify him which 
of his men had not been recommended for overseas duty, so that the branch 
officer would know what to say to each man when he met him. This was the 
director’s most painful task: to explain on the telephone the reasons for 
rejecting a candidate who, in most instances, had been carefully picked and 
skillfully recruited, who, not seldom, had left an important position and 
perhaps traveled a thousand miles in response to the urgent call of the 
OSS, and who might even be a lifelong friend of the administrative officer. 
On this day l^etwecn classes the director frequently had occasion to discuss 
with administrative officers problem and borderline cases, making clear to 
them the staffs reasons for pasvsing or failing candidates. In turn, the director 
usually passed on to the staff the branches’ reactions to its decisions, and this 
information served to keep the staff in close touch with the viewpoints and 
attitudes of the administrative officers. 

The picture we have given of the operations of the staff may strike the 
reader as being too glowing and ideali/ccL In truth, it presents our staff 
work at its best, as it was carried out after the program had been stabilized, 
during the |icric)ds when the ju'cssurcs and disturbances that beset assess- 
ment were at a minimum. Such times were sufficiently long and frequent 
that the experience, of being a participant in well-organized, stimulating 
work carried out with good will and zest became for most members of the 
staff the outstanding feature of die season spent as S. This high level of 
vigorous and harmonious functioning could not be maintained at all times. 
The main factors militating against it were insuflicicncy of staff, shortage 
of time, and overload of work. The almost constant unavailability of suit- 
ably trained men for the staff often led to an undermanning of teams. At 
such times the interviewers had to handle more cases than they could 
thoroughly work out, and were sometimes prevented from attending some 
of the situational tests. Occasionally, the usual expertness of the schedule 
makers failed, and a staff member would be bewildered to find himself 
assigned to two different places simultaneously. The undermanning of 
teams also affected the quality and quantity of observations. This was par- 
ticularly true when the riiimhcr of candidates^to be ob.scrved in the dii?crent 
situations was larger than usual. It wa,s our experience that five persons 
working in a group coirld be easily kept under surveillance, but that it was 
hard to take in all the activities of a group of seven. The shortage of time 
resulting from a crowded schedule was particularly damaging to the un- 
scheduled team meeting.s; the rating conferences were .sandwiched in be- 
tween procedures, and frequently, instead of taking place soon after the 
situation, they had to be postponed till late in the evening. At such times 
the team members might find themselves unable to recall their observations 
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of the early morning, and too sleepy to be interested in discussion, Under 
the combined pressure of lack of time and of fatigue, the discussions would 
be reduced to a minimum and an averaging of ratings would be substituted 
for agreement. When a large number of reports had to be written, the meet- 
ing of the team on the last day was cut short, or even reduced to a discussion 
between the interviewer and the skuationist who was to write the report. 
After the two parts of the report were written there was often no time to 
compare them, so that their integration had to he achieved in or after the 
staff conference. Some of the reports were even written during the con- 
ference, the writers dividing their attention between scribbling and listening, 
The principle of continuing the staff discussions of difTicult cases until 
clarification was reached could not always be adhered to, because of the 
limited time. As a result, the director, on reading the typewritten report, 
might have to consult with its author to decide on further changes. 

Reasons other than lack of time and pressure of work were occasionally 
responsible for departures from the ideal Forces inherent in social relations 
generally— mutual likes and dislikes, bids for dominance or prestige, tend- 
encies to yield too readily to group pressure— were not without effect on 
our proceedings. Thus not all individual prejudices were corrected. On the 
whole, however, the disruptive influences were at a minimum. In the emo- 
tionally positive climate of S they were for the most part freely expressed 
and easily overcome. The variety of the program and the experimental 
spirit that pervaded it permitted each staff member to attach himself to 
some procedure that best corresponded to his interests and abilities and to 
attain special proficiency in it. Some were noted for their skillful and sensi- 
tive handling of Improvisations, evoking maximum spontaneity of the 
“actors*’ as well as productive discussions of their performances by the 
audience. Others were known for the spirited manner in which they con- 
ducted the Debate. Still others for their ability to get the most information 
out of the projective material, or for interviewing skill, or for being able to 
put their formulations of personality development into the context of a 
wider sociological background. We had our specialists in standardized paper- 
and-pencil tests and in statistical techniques, our “idea men** and organizers 
of research; the Stress Interview was a one-man show. The satisfaction that 
each man derived from the work itself and from the recognition that his 
specialized contribution was appreciated by the others went a long way 
toward maintaining high motivation and toward helping everyone to 
maintain his poise in the face of the inevitable series of frustrations. The 
presence on the staff of some persons who attracted the esteem and affection 
of all acted as another unifying factor, one that greatly enhanced the enjoy- 
ment of teamwork. The staff work was more than a mere necessary division 
of labor, and more than a means of safeguarding conclusions against sources 
of error inherent in clinical methods. At its best it represented actual col- 
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lective thinking and collective problem solving which resulted in more valid 
and adequate decisions than could have been achieved by any one individual. 

REFLECTIONS ON PROCEEDINGS 

S as a Standardized Society.— S was a society like a ship’s crew organ- 
ized by a temporary necessity which separated them from the rest of the 
world. It was more than a place where tests and situations were admin- 
istered. It was where the candidates lived, ate, slept, competed, and played 
games together. They took each other’s measure and assumed their parts 
in the social intercourse. Some quickly rose to the top and were at once 
acknowledged as outstanding; some fell to the bottom, and others vacil- 
lated, trying to find their rightful place in the scheme of things. A few 
quit, the problem of adaption being entirely insoluble for them. 

Moreover, the adjustment of the individual to this society affected his 
performance in the various tests, and his performance, of course, affected 
his adjustment. This was as it should be, Living, doing, behaving, thinking, 
are not mutually exclusive. As a consequence, the evaluations of the staff 
combined facts learned from both formal test and informal living. Fre- 
quently the most significant data were the uncontrolled observations of 
casual deportment before and .after one of the carefully standardized tests. 

What is more, not only did this society at S permit the continuous observa- 
tion of the adjustment and performance of the subject but it also provided 
the fullest possible control over the setting of the test administration. 
Rarely if ever before had the setting been kept so constaitt, not only during 
the test but before and after as well. 

Perhaps more important than the constancy of superficial conditions of 
a test, like place and time, was the elimination of formal differences among 
candidates, by withholding their true names and dressing them all alike 
in fatigues. This matter was crucial for evaluating the interrelationship of a 
subject and his colleagues. The effect of name and dress on social relation- 
ships and on submission-dominance patterns is obvious, and even the most 
careful and conscientious observer may be prejudiced, if only unconsciously, 
by outward appearance and family derivation. And although such factors 
may well be considered in making final evaluations, it is well that at least 
such easily changed accouterments be held constant when measuring the 
personality, especially since the subject may be required to function where 
“what he is’’ rather than "who he is’’ will be vital. By assigning cover-names 
and cover-alls, S produced a uniform anonymity which shielded psycho- 
logical judgments from interference by irrelevant and misleading factors. 
So far as possible the endeavor at S was to see the person whole and to see 
him real. If he achieved a desirable niche in the society of S he did so on 
his own merit, If he carried distinction, it was not the distinction bought at 
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Brooks Brothers or bestowed by virtue of his grandfather’s shrewd specula- 
tions in railroad stock. 

It was similarly desirable tliat the candidates invent fictional past his- 
tories as background for their interpersonal communications. Thus all 
started on the same level at S, for they could not lean on the prop of former 
achievements, true or fancied. They could not boast of a high status if they 
had it, and any status they mentioned was known to be false. The philos- 
opher who said he was a dltchdigger wa^s no more believed than the ditch- 
digger who said he was a philosopher. And it did not matter; for this was 
a society where achievement was more impressive than pretension and in- 
trinsic effectiveness more telling than presumption. Each person had to 
demonstrate his worth; he could not rely on his investitures, He could not 
produce a large bank roll to offset his superficiality, nor use the pose of 
"creadve ardst” to excuse his narcism. He could not silence his fellows by 
listing the books he had written or by fingering his Phi Beta Kappa key. 
He came naked. So far as past history and achievement were concerned, 
all men met on the same terms. The actual case of the general and the 
corporal who, ignorant of each other’s rank, lived as convivial bunkmates 
was no exception. S was the truly classless society. 

Numerous duties and obligations had to be fulfilled— appointments to 
be kept and tasks to be performed— but there were also opportunities for 
informal social intercourse. There were kindnesses to do and favors to 
request. There were opportunities for personal initiative and group coop- 
eration. And always, as in everyday life, there were the barb of competition 
and the understanding that the achievement and reputation of each were 
being measured and recorded. 

The structures of the societies constituted by the successive classes at S 
exhibited certain uniformities. As in any group of more than a few members, 
specific affiliations of two or three persons began to develop soon after 
arrival. Several factors encouraged this tendency, The sleeping quarters 
consisted of three rooms, and it was easier to become acquainted with room- 
mates than with others. Then, too, the men sitting together at each of the 
several supper tables on the first evening were apt to strike up an ac- 
quaintanceship and join each other at subsequent meals. The major group- 
ings, however, were the class as a whole and the three subgroups of six, 
who worked together in the various situational ce.sts. The candidate’s loy- 
alty to the whole group was casual, like the soldier’s to his company, which 
competes with ocher distant companies. But it was quite direct and warm 
to his subgroup, like the soldier’s affiliation to his own squad within the 
company. 

The first interpersonal duties and obligations of the candidate at S were 
to his subgroup and here also he first competed overtly for status and recog- 
nition. The subgroups were composed with an eye toward homogeneity of 
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membership with the widest possible opportunity for personal interaction. 
They were designed so that the success of each candidate depended, so far 
as he knew, cm the cooperation and effectiveness of every other member of 
the team. It was here that the sharpest likes and dislikes were formed. It 
was here that respect and recognition were gained and lost. The effective 
and the ineffective, the aggressive and the submissive, the leader and the 
follower were quickly perceived, The '‘good Joe/' the “queer duck” the 
“lone wolf,” the “team worker” were readily distinguished. The general as- 
sumption was that each candidate took his place in the subgroup at S much 
as he would do in his office or in his field team overseas. 

There was, however, another milieu operating, namely, that of the whole 
group. Here the interaction was not dependent so much on the candidate’s 
accomplishment and efficiency in the doing of specific tasks as on his over- 
all effectiveness and impressiveness under informal circumstances, although 
there was, of course, some carry-over from one to the other. The difference 
between the opinion of the subgroup and that of the whole group was very 
much like the difference of impression formed in the more or less enforced 
collaboration of the office or platoon and that formed by meeting the same 
person in a larger population, say, in a country club or in a company day- 
room. Interaction is present in both places but on a different plane of in- 
timacy. In both places peculiarities, but different ones, are apparent, likes 
and dislikes are farmed, in-groups and out-groups produced; but these are 
based in the larger group on social interrelations rather than, as in the 
smaller group, on working interrelations. Needless to say, in the usual 
course of things and especially in the requirements of the OSS, the two are 
equally important for the true evaluation of a candidate. 

It was significant and frequently enormously helpful in understanding 
individuals to know that the person who was most rejected by his sub- 
group was sometimes also the person who was most accepted by the entire 
group (excluding, of course, the members of his own subgroup), and that 
the most respected member of the subgroup was sometimes just a “dud” 
to the rest of the community. 

In making his adaptation and contribution to these various planes of the 
society at S, the candidate revealed facets of his personality not otherwise 
observable. At least as much could frequently be inferred about a man from 
the place to which he wns allocated by his fellows as could be gathered from 
anything he said about himself to the interviewer or did in the formal 
testing periods. The methods of observation, the role of the staff in this 
society, and the procedure for obtaining the candidates* judgments of each 
other are described elsewhere. For a clear understanding of S, however, 
these three points should be kept in mind; (i) S was a continuous proceed- 
ing, with the situations and tests merely incidental to the total process. 
The informal sociality was as important as the formal measurement, the 
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baseball game as significant as Belongings. ( 2 ) No test score or average of 
test scores was considered as a final judgment. The ratings were merely 
memoranda to be viewed in the light of the total impress of the subject upon 
the society and the staff, (3) No test or theory was permitted to hinder the 
task of assessing each personality as a "single behaving organism in a 
society.” 

One example will illustrate the procedure. Charley came to S in a group 
of eighteen candidates of similar age. His performance on the written tests 
was outstanding: he scored top grades in Intelligence^ Vocabulary, Mechan- 
ical Comprehension. He was knowledgeable and well informed. He was 
willing to help in the subgroup, and although he exerted no leadership, he 
tried to be useful and friendly, Yet he was not recommended by S for ac- 
ceptance by the organization. Although the individual scores averaged 
“satisfactory," Charley, the person, did not, Although he knew all about 
the writings on sociology, he knew nothing about how to live socially; 
although he knew the book, he did not know the practice. He was not 
Charley to his colleagues, but "poor Charley" or "poor old Charley," or 
“Charley-horse.” He was, In the society that obtained at S, a butt and a 
laughingstock. In spite of Certain test score.s, he was the class “dunce," He 
could never be an acceptable member of a team; he could never live 
congenially in barracks. 

In this case validation was almost imraccliatc, for several of his college 
mates were acquaintances of a staff member. They were unanimous in 
reporting that Charley was at the top of the class in marks and at the bottom 
in everything else, "He was," they said, “a kind of superintellectual joke." 
So far as assessment was concerned, the so-called informal section of the 
process had contributed more than the formal section. And so it should be, 
for the activity of adults is rarely in the schoolroom, and their effectiveness 
hardly ever apparent outside their intercourse with others. After a given 
minimum of intelligence, there are few jobs that do not depend more on 
general personality effectiveness in society than on sheer intellectual power 
in a cell, In wartime and certainly in the OSS, the job that could be done 
by a superintelligent hermit was rare as compared to the job that could be 
done by a sociocentric person of moderate intelligence. 

Interrelationships of Candidates and Staff,— No facet of the program 
at S was more essential to the success of assessment than the interaction 
among the candidates and between them and the staff. The candidates were 
observed largely against the framework of the society established by the 
active participation of all habitants of S. 

It was a fundamental principle of testing and of assessment at S that the 
subject be observed when he was trying to do his best, even though some of 
the tests were designed to catch him at his worst, A standard condition 
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without which assessment is impossible is that all candidates be motivated 
to do their best and to show themselves in a favorable light. Otherwise it 
is like measuring the height of people when they are seated or the speed of 
greyhounds without the rabbit. If living at S was the basic test of the 
assessment program, it was important that the candidate be motivated to 
live as well as he knew how. For example, although it might not be es- 
pecially reprehensible for a man to become drunk at a party in his own 
home, it was usually counted against him to give in to temptation and be- 
come drunk at S. But it was important that intoxication at S should not be 
the manifestation of a candidate’s indifference or antagonism to assessment. 
It should be a true measure of his inability to control himself, despite his 
desire to do so. Similarly, lack of intelligence or poor social relations should 
be measures of the candidate when he exerts himself to do his best, and 
not be products of his lethargy or resentment. 

Thus the society at S had two fu notions i first, to provide the framework 
within which various dispositions and abilities could be observed; second, 
without which the first would have been impossible, to create a friendly 
atmosphere in which resentments could be resolved and the most favor- 
able relationships between assessors and asscssces could be developed, 

Contemplating in retrospect the society that was S, one can realize the 
importance of the tacit working principles that guided and shaped the 
assessment community. They are rules to be remembered in any future 
assessment. 

i) The prevailing atmosphere should be one of Gemiitlichl{€iti of in- 
formal but well-orclercd friendliness. Rigid and directed social and athletic 
prograrr^s are likely to prove tedious, but a staff member should always be 
available for “shooting the breeze,” for taking part in a game of badminton, 
horseshoes, bridge, or even charades. Of course, the usual clubroom para- 
phernalia should be available as well as the icebox for the “midnight snack.” 
The pervading social climate, except during formal testing periods should 
be that of a group of congenial associates enjoying an enforced stay with 
hospitable but not effusive hosts, the staff. 

i) Within the framework set by the physical characteristics of the area, 
the structure of the staff, and the restrictions necessary for the formal test- 
ing, each candidate should be given the widest scope for living and self- 
expression. To evaluate him best he should be given liberty; even more, he 
should be encouraged to stretch himself in his assessment environment as 
he would normally. 

3) Resentments necessarily engendered in candidates by the character of 
such tests as Stress and Construction should be dissipated. The process of “de- 
compression,” although part of the diagnostic procedure, should be a regular 
adjunct to any test involving personal humiliation. Frustration in one test 
should not carry over to affect performance in another. The hypersensitive 
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individual will evidence him.self most clearly if nil except him are relieved by 
the decompression. With accumuhuinj; rcscnuiumt^ the hostility toward the 
single test is diverted to all tests and more especially to tlic stall, a condition 
under which the advantageous iiueractioti tif stall and catulidatc is im- 
possible. 

4) There should be a clear diclu)U)my lietwccn tiic met lux I of observa- 
tion adopted in the formal tests and that praetited dming [ycriads of recrea- 
tion. In the former, the stall member is an oven nonparticipant observer; 
in the latter, he is a covert participant r)l>scrver. During inomcius o£ leisure, 
spontaneous sociability is primary, obscrvadijn secondary. If diagnostic data 
are forthcoming they will be noted, but If the subject suspects that he is 
being "sized-up"' or '"pumped” under the subterfuge of iriformal conversa- 
tion, he may withdraw permanently. If the interaction is genuine, the ob- 
servation will be genuine too, And oi course rite srafl should never intrude 
on the privacy of the candidate excejH during the Interview, and should 
not, except under test conditions, attempt to trip him up tin his cover story 
or similar matters, The greatest compliment that cant be paid to a staffs 
informal observation is that it is not apparent. 

Of course, there arc no .set ways to act in a[)[ilyiiig these princi[)lcs suc- 
cessfully. Much depends on the light and shade of inicrper.sonal adjustments 
within the staff and their reflection in the candidaics. Ii was .striking to 
note how sensitively the cla.sscs reacicil to moods of the siafi, WIumi “things 
were right,” an atmosphere was created which clitninared strain; the widest 
latitude was given to individual initiative; both candidates an<l staff worked 
together for a single purpose— the best evaluation of every man. Under 
these conditions, the motivation of the candidates to ap[H‘ur at t][icir best, 
yet to be perfectly frank about their deficiencies, was astonishing. No task 
was too arduous, no question too intimate. Perhaps most ama^.ing and 
gratifying was the open appreciation expressed by the candidates for the 
efforts of the staff. 

No rigid adherence to rules can produce a result f)f this sort, for the 
latter is the outcome of such intangibles as morale, s[)irit, esprit de corps. 
One truism worth mentioning is that if the candidates see the staff work- 
ing hard at a job it takes seriously, they will do likewise. At S, more often 
than not, so it seemed to us, the required intangildcs were operative. Every- 
one knew it when things were riglit and knew it when they were wrong. 

Friendliness and trust can often be cl is tur lie cl by a minor incident. For 
instance, by accident it so l^appcncd with one class that at the first supper 
all the candidates found themselves seated at tables sc[U\rate from the mem- 
bers of the staff. The remark was clearly heard, “Ah, separate tables— 
separate food too, I suppose.” The next day when the members of the staff 
took their usual places among the candidates, the question, spoken and 
unspoken, was, “Slumming, are we, this morning?” And this attitude of 
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separateness and discrimination carried over into the assessment contacts 
too. Assessment can be easily resented: no one likes to be judged. This 
accident, however, was the exception. Usually, die candidates who were pre- 
pared to scoff at the long-haired p.sychologists found themselves playing 
ball, discussing foreign affairs, or swapping yarns over a beer with ordinary 
human beings. The most frequent comments were, ‘'We came out feeling 
that we were going to be tested by some professors and discovered instead 
that we were living with a pretty good bunch of Joes.** It is the contention 
of S that more can be learned of people by living with them as “good Joes” 
than by testing them ns professors. 

General Considerations on Situational Testing Although every part 

of the time at S was a free sampling of the candidates’ lives, the situational 
tests were the most carefully structured and observed behavior samples, 
A wide range of approaches was available, because any circumstance which 
provokes behavior and gives opportunity for psychological observation is, 
within the meaning of the term, a situational test. The staff at S experi- 
mented with procedures ranging from that of merely leaving several candi- 
dates in a room without instructions to that of prescribing rigid rules ac- 
cording to which the men would enact what amounted to the last scene of 
an unfinished play. It became clear that the first of these was wasteful of 
time and depended too much on the chance whims of the more restless 
members of the group, and that the second allowed little leeway for the 
spontaneous impulses of the participants, The following guiding rules 
for designing situational tests are based on twenty months of experimenta- 
tion. 

1) Every situational task should have a number of alternate solutions. 

2) The accomplishment of a situational task should not require very 
specialized abilities, because if it does, a large proportion of the candidates 
will be seriously handicapped and unable to participate on a level with the 
“experts.** 

3) Situations should be designed to reveal the kinds of behavior which 
cannot be registered by mechanical means. As a rule, simple skills and 
abilities arc better measured by rigidly controlled tests; emotional attitudes 
and social behavior, by more flexible situations. 

4) Situations should be constructed which force the candidate to reveal 
dominant dis[XJsitlons of his personality. The fruitful problem is one which 
evokes complex behavior with significant emotional components. A test of 
skill, of course, may be imbedded in a situational context and two evalua- 
tions obtained concurrently — an estimate of the given skill and a judgment 
as to certain components of personality. For instance, both agility and 
courage could be estimated at several of the obstacles in the Obstacle Course. 

5) The most productive situations are those which involve group inter- 
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action: each man is called upon to accomplish something with the aid of 
a few co-workers under conditions whicli encourage initiative and the dis- 
play of unique patterns of response. A tug of war, for example, is not a 
very revealing group situation because It restricts the individual to a narrow 
norm of action. It is from the friction engendered by competing ambitions 
within a working group that sparks arc struck which illumine the person- 
alities involved. 

6) The situational task should be one which requires, for its best solu- 
tion, the coordination of numerous components of personality. The candi- 
date should be pressed to bring many of his resources to bear on the con- 
fronting problem, Testing single aspects of behavior is a questionable pro- 
cedure, because in real life processes do not occur singly. 

7) Modification of the situation to fit the experience and abilities of the 
candidate may in some instances be advisable. In the Assigned Leadership 
tests, for example, misleading results will be obtained if tasks arc assigned 
without regard to the individual’s talents and training. 

8) The candidates should be given an opportunity, cither in the course 
of the task or immediately afterward, to discuss their performance. Much 
can be gained from the subject’s own account of how he would, or of how 
he did, handle the assigned problem. He is usually capable of giving the 
most plausible explanation of his own behavior. In making its evaluations 
of performances in such tests as the Brook and Assigned Leadership, the 
staff at S was greatly aided by ihc commentary of the participants. In 
Improvisations the commentary was an integral part of the proceedings and 
was therefore still more helpful to the assessors whose task it was to inter- 
pret the behavior. 

9) The members of the staff should have ample opportunity to confer 
after the situational task has been completed. This is the time to discuss 
and synthesize the different interpretations of the observed behavior. We 
assume that no single examiner is capable of accurately recording and in- 
terpreting all the component actions of a complex group proceeding. 

These nine guiding rules may be of some use for the immediate future, 
but they do not, by any means, solve the bulk of the perplexing problems 
involved in the invention, observation, and interpretation of situational 
procedures. These situations are still in an early imperfect stage of evolu- 
tion. Sometimes they '^come off” astonishingly well-— in tho,se instances, for 
example, when, at the emotional peak of a tensely developing interaction, 
the characters of the leading participants are suddenly revealed, as at the 
climax of a drama, in their true colors. At other times, however, for no 
apparent reason, nothing very significant transpires. 

In evoking emotional components the most successful situation used at 
Station S was Improvisations. This was the only procedure in which no 
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ratings were attempted, the whole attention of the staff members being 
directed toward one actor and then the other, in an attempt to interpret 
the clues to personality structure embodied in words and gestures. One of 
the most rewarding features of Improvisations was the exchange of views 
of members of the audience as to how well each participant had handled 
the other in the given situation. Since both of these were required to ex- 
plain, if not to defend their actions in the face of such comments, they were 
likely at this point to become emotionally involved and give some indica- 
tion of the level of their tolerance of criticism. The insights gained from 
these miniature incidents were more significant, though assuredly less codi- 
fiable, than any other procedure except the Interview. 



Chapter VI 

ASSESSMENT AT S: ANALYSIS OF VARIABLES 


Station S was established as a service center. We had no directive to do 
research. We were recruited to assess men and women, and those who 
recruited us expressed their confidence in our ability to fulfill this function. 
But without exception, we were only too aware of the limits of present 
knowledge and of the fallibility of our judgments. We would have liked 
to have had time to plan the program in detail and the opportunity to criti- 
cize all that we did. But the war was on; a job had to be done at once, and 
50 with a minimum of theory and all the common sense that we could 
muster, a program of assessment was set going. This to us was what the 
Construction situation was to the candiclatcs—a test of frustration tolerance. 
The branches wanted ratings of certain traits of personality on each recruit 
— intelligence, emotional stability, social relations, security, and so on— 
but we wanted an opportunity to discuss the whole [iroblcm of traits. After 
all, we wondered whether there were such things as traits of personality, and 
if there were, whether the qualities which we had been asked to measure 
could be classified among them. To have had time to discuss problems of 
this sort and to come to a group decision on each might have resulted in a 
much more effective program of assessment. 

Then, too, confronted with the unique task of studying a large population 
of normal and supernormal persons, we would have desired to seize this 
opportunity for a carefully planned research into problems of the structure, 
function, and development of personality, to say nothing of research into 
the technical and methodological problems of assessment. 

But the immediate and practical demands of assessment left us no time 
for the construction of an experimental design. Even the hope that sooner 
or later the load of assessment would be lightened, or the size of the staff 
increased to the point where such experimental planning might be done, 
was never realized. And so, looking back over what we did, we find little to 
report that can in any sense be regarded as a contribution to a better under- 
standing of personality. Our experience convinced us of the Inadequacy if 
not falsity of much that we had believed in the past about the role of various 
experimental factors in the development of personality, especially in its 
abnormal manifestations, but the pressure of work kept us from ever set- 
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ting up program of research that might have yielded some of the sorely 
needed facts pertinent to these issues. 

The record of our work must then, perforce, be a descriptio'n of what 
we did as a service unit rather than a report of research findings. To be sure, 
variations both in the over-all program and in individual procedures were 
frequently introduced, first to improve the quality of assessment, and second, 
where possible, to suggest the answers to certain theoretical questions. But 
no claim is made that an analysis of our conceptualizations and measure- 
ments of the variables can amount to more than a record o£ what was done 
with a few suggestive hints for future research. It is with this warning 
before him that the reader is invited, if he is still interested, to survey in the 
pages that follow the psychological and statistical analysis of the variables 
of personality that were rated in the assessment program at S, and into which 
we sought, though largely unsystematically, to gain new Insights. 

THE SEVEN PERIODS OF S 

In the rest of this chapter, references will be made Lo various periods in 
the life of Station S. These subdivisions of its twenty months’ existence 
were set up afterward purely to facilitate the statistical analysis of the 
thousands of ratings and scores. The dividing points were chosen to ap- 
proximate the points at which new procedures were introduced ns substi- 
tutes for those that seemed least fruitful. All but one of these transitions 
were minor turning points in the evolution of the program described in 
Chapters 3 and from June, 1944, to V-J day, no revolutionary changes 
occurred. 

The chronological details of the seven periods are given in Table i. 
During most of Period A, the staff saw two classes a week, one from Sun- 
day afternoon to Wednesday morning and the other from Wednesday after- 
noon to Saturday morning. For six weeks, the assessment load was as 
high as 80 a week. This large number was handled by picking out five to 
ten of the obviously satisfactory candidates and returning them to Wash- 
ington after twenty-four hours. On Tuesdays and Fridays, special classes 
of six to twelve arrived for a rapid six-hour assessment, these being the 
forerunners of the one-clay classes at Station W. Twenty-five variables 
were used during Period A, of which at least fifteen were rated for each 
candidate. 

The new sclicdulc cjf tlircc classes every two weeks was instituted just 
before Period B began. Another major change was the adoption of the final 
report sheet with nine variables. The reduction, was accomplished mostly by 
grouping related variables; thus Observation and Reporting was defined 
to include the grades which had formerly been listed under Observation, 
Memory, Inference, and Reporting Ability, Also at this time, the practice 



232 


Assessment of Men 

of having a staff team of three follow the same group of candidates through 
all tests replaced that of assigning one staff member to observe all candi- 
dates on one test. The change enabled each member to obtain a rather com- 
prehensive conception of a few candidates instead of a superficial impres- 
sion of all of them. 

Period C was marked by the abandonment of the time-consuming and 
barely reliable Flashlight Observation Test, the addition of the OWI Test, 
and a few minor changes in the variables rated in certain procedures. From 

TABLE I 

Subdivisions in the Life of Station S 


Period 

1 

Class 

oumbers 

1 

Dates these classes arrived 

Number of 
candidates 
assessed 

A 

I- 44 

December 30, 1943— June 1944 

961“ 

B 

45- 58 

June 6, 1944 — August 6, 1944 

154 

C 

59- 74 

August 10, 1944 — October 19, 1944 

Z59 

D 

75 - 91 

October 13, i944~January 15, 1945 

Z57 

E 

91- 99 

January zi, 1945 — February z6, 1945 

135 

F 

ICXJ-119 

March 4, 1945— June 4 . i 945 

309 

G 

IZO-IJ4 

June 10, 1945— August 13, 1945 

195 



Total 

2 -. 37 I 


* Includes 230 candidates whose assessment lasted less than a day. 


this time on, for example, Social Relations was rated at the Brook. Begin- 
ning with Period D, the SIX-2 Test was included in the program, and the 
interviewer’s estimate of the candidate’s integrity was recorded for reference 
and research purposes. While this latter grade was not reported, any suspi- 
cions of low integrity were discussed in the report. Period E saw the elimi- 
nation of the Recruiting Test because this function would not be required in 
the Far East to the same extent as it had been in Europe, 

The Assigned Leadership problems became a regular part of the program 
with the first class in Period F. Period G was marked by the reclassification 
of Motivation scores under two variables, Motivation for Assignment, and 
Energy and Initiative. On the new report form instituted at this time, 
(a) Propaganda Skills and (b) Observing and Reporting were omitted from 
the list of variables because these were pertinent to specific assignments 
only, and because there was a place on the new second sheet for recording 
estimates of these two aptitudes. Since there was no longer any problem of 
language handicap among the candidates, the Otis Self-Administering Test 
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of Mental Ability replaced the nonverbal Progressive Matrices and Series 
Completion Tests, Also, verbal persuasiveness at the Discussion and the 
Debate was no longer rated as part of Propaganda Skills because it was not 
relevant to written propaganda in the Far East. 

MOTIVATION 

From the beginning of the program at S Motivation was defined to include 
two variables; (i) the candidate’s desire to accomplish an assignment in the 
OSS, and (2) the level of energy and initiative generally displayed by him in 
pursuit of goals. These two factors, or sets of factors, which may be presumed 
to be largely independent of each other, were scored on the basis of different 
types of data. The score on Motivation for Assignment was mostly based 
on information obtained from the candidate in the Interview, with some 
additional contributions from Discussion, Debate, and Post-Stress. Energy 
and Initiative, on the other hand, was rated as a unit largely on the basis 
of the candidate’s performances in group and individual situations. During 
the first few months (Period A) Motivation and Initiative were treated as 
distinct variables, hut in Period B their separate treatment fell victim to the 
policy of creating large clusters, and they were combined into one variable 
under the label “Motivnlion.” It was not until the last few months of assess- 
ment (Period G) that they were once again distinguished and assigned 
separate final scores. In Periods B through F the single rating on Motivation 
represented a compromise between the average of the Energy and Initiative 
scores obtained in the various situations and the interviewer’s score on Mo- 
tivation for Assignment, with the latter being given much the greater 
weight. This dLs{X)sition to favor the interviewer is well illustrated by the 
fact that in Period B the final score on Motivation correlated with the in- 
terviewer’s rating of Motivation .83, whereas the median correlation of the 
final score on Motivation with all other subscores of this trait was only ,^4. 
Because of this marriage of two distinct concepts the statistics involving the 
final scores on Motivation arc relatively unambiguous only for the data of 
the first and of the last period, I'or periods in between, the final scores on 
Motivation represent largely Mf)tivation for Assignment and will be treated 
as such, It must he remembered, liowcver* ihat they deviate from the origi- 
nal ratings given by the interviewer to the extent to which they were in- 
fluenced by the Energy and Initiative factor, 

MOTIVATION FOR ASSIGNMENT 

Distribution of Scores.»-A consideration of the distribution of the final 
ratings of Motivation for Assignment may help to clarify some of the as- 
sumptions underlying the scoring of this variable, The distribution of these 
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tatinis for various periods of assessment at S is given in Table a. Two 
peeuliarities of this set of distributions are appa.att at a glance i sb.ft. ,n dis. 

talon between Periods A and C, with stabil, nation from C on and the 
negative skewness of the distribution throughout a 1 periods. Tins skewness 
i, Lreme in Period A, with 58 per cent of the ratings falling in the 4 and 
e categories. The typical distribution of the ratings of ihis variable is like that 
of others in having few extreme scores m the lower end of the scale (o, i); 

TABLE 2 

Percentage of Ratings in Each Category of the Scale Given on Motivation for 
AvSsignnicnt in Each Fcriotl ot S 



but it deviates from all other distributions in showing excessive frcciucncics 
of 3 and 4, rather than of 2 and 3. The percentage of liighest ratings (scores 
of 5), while not always reaching the theoretically desiiaihlc 7 per cent, is 
higher than in the distribution of any otlier variable. 

The shift in the distribution between Periods A and C has probably more 
than one cause. In the beginning we were Impre.ssed with the high motiva- 
tion of our candidates as compared with that of the general population, and 
consequently gave them high ratings. The fact that in Period B the variable 
was made to include the Energy and Initiative factor as well as Motivation 
for Assignment may have had something to do with die cliiuiges from 
Periods A to B, Other changes in the rating procedure iusdlutcd at the be- 
ginning of Period B, most notably the use of tlie scorclioard in the conference 
room, may also have played a role in producing a shift from tlic extreme 
coward the middle ratings. On the other hand, tlic fact that the .shift contin- 
ues beyond the point of introduction of new [irocedures suggests the po,ssi- 
bility that to a certain extent the shift reflects aciual changes in the assessed 
population. In Period A, 58 per cent of tlie assessed personnel were civilians, 
as compared to 41 per cent in Periods B and C, 26 per cent in D, and only 14 
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per cent in Period G. One may assume that with the exception of people 
recruited for unusually hazardous operations, volunteering from the civilian 
status was indicative of greater motivation than volunteering from the Army 
or Navy, since a large proportion of the military personnel expected to be 
sent overseas anyhow and had little reason to suppose that the OSS was 
much more dcsiraldc than the unit from which they had been transferred. 
Actually in Periods A and H— but only in these— civilians received a higher 
percentage of high ratings (4, 5) than did the service men. Furthermore, it 
appears plausible that among both civilians and Army personnel those who 
were most eager for an OSS assignment overseas would be among the first 
to volunteer or among the first, at least, to attract the attention of the or- 
ganization, One specific factor was the presence in the earlier groups of a 
large number of cinljrns who were very articulate in expressing their eager- 
ness to participate in the war against Fascism, This group dropped out to- 
ward ihc end of the European campaign. Then too, with the progressive 
depiction of man power in the United States, the amount of spontaneous 
active volunteering seems to have decreased relative to the amount of passive 
acquiescence in response to recruitment. But whatever the factors involved 
in the shift of ratings, they either stopped operating after the first twelve 
hundred candidates had passed dirough S, or were counterbalanced by 
other factors. The distribution of ratings from Period C on shows only 
random fluctuations. As an additional check, in a special study of motivation 
which included all classes between December 4, 1944, and May 6, 1945, 
the interviewers’ estimates of: the strength of the candidate’s desire for his 
assignment, coiiclied in descriptive terms rather than in numerical ratings, 
show no systematic variation through the period; 55 per cent of the 482 
candidates assessed during this period definitely wanted the proposed assign- 
ment, and an additional 27 per cent were sincerely enthusiastic about it, 
willing to make essential sacrifices in order to obtain it. About 15 per cent 
were neutral, or hesitant though still willing to accept it. Only a negligible 
percentage definitely did not want the assignment ofiered to them. 

These facts help us to understand the reasons for the skewness of the 
distribution that persisted throughout. The fact is that in the case of Motiva- 
tion, although we did compare the candidates with each other, our attempts 
to distribute our ratings were not very determined and persistent. In the be- 
ginning we felt the average motivation of our volunteer population to be 
high in comparison with that of the total adult population of the country, 
and scored it as such, In addition, it is quite likely that the semantic factor 
involved both in the verbal and in the numerical designations of the steps 
of our rating scale was of particular significance in the case of Motivation. 
While it seemed reasonable to rate as zero the emotional stability of a 
person who had suffered a severe breakdown, or the social relations of a 
person who had managed to antagonize all his colleagues and the staff, 
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it did not seem reasonable to rate as zero, or even as i, the motivation of a 
candidate who truly wanted an assignment, even though he was less en- 
thusiastic than the majority. Had our scale started with i as the lowest 
score, or had all steps been designated by letters, our ratings might have 
been distributed somewhat more normally, However, after having dis- 
covered and discussed the skewncvss of the distribution of ratings we re- 
frained from any attempts to correct it, and for gcK)d reasons, High 
motivation for an assignment was considered a prerequisite for placement 
by the administrative o/Ticcrs and was used as one criterion of selection in 
recruitment. In view of the difficulties that we as psychologists had in 
adhering to the normal curve in our -tatings, it seemed futile to try to 
impress the administrative officers with the fact that a candidate who had 
been selected from among others because of his special interest in an assign- 
ment might obtain a low average score on motivation merely because he 
was now being compared to a large number of very zestful individuals, 
Since our whole rating procedure was intended, among other things, te 
facilitate communication with the branch administrative officers, we acted 
in accordance with our aims when we permitted the '‘high" motivation of 
our candidates to remain high in our ratings. 

Types of Motives.— In the rating of the variable Motivation for Assign- 
ment various aspects of it had to be taken into consideration. The motiva- 
tion had to be strong and durable: only sustained motives, well integrated 
with the person’s prevalent needs and attitudes, and not undermined by 
opposite tendencies, could be relied upon to ensure his persistent effort 
in the face of dangers, discomforts, frustrations, and boredom. IE, as fre- 
quently happened, the person selected for a particular job upon arrival in the 
theater found this job superannuated, he had cither to make the best of the 
totally different work given to him, or to create a job for himself that would 
be more than a mere makeshift, Strong motivation was necessary to prevent 
people from turning bitter or cynical under such frustrations. However, 
strength and persistence of motivation were not enough: its quality had also 
to be considered. The particular natures of the person’s motives were sig- 
nificant; they might make him disregard orders and over-all plans, or break 
security rcgulation.s, or involve him in difficulties with his co-workers or 
superiors, thus diminishing his usefulness, or even endowing him with a 
distinct nuisance value. Reports from the field cited instances of people 
whose qualifications could not be fully used or even used at all, because the 
nature of their motivation made them security risks, or disruptive influences 
in their unit, or ‘^problem children" who had to be handled with care. On the 
other hand, the motivation of some men was of such a nature that it not 
only ensured their own maximum performance, but was a powerful morale 
factor which raised the efficiency of the group to which they belonged. 
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The rating of Motivation for Assignment was left almost entirely in the 
hands of the interviewer. Some additional information was obtained by an- 
other staff member in the course of the Post-Stress Interview, but it was 
often not particularly clear cut, and was superficial at best. Only in a rela- 
tively small percentage of cases did the Post-Stress yield valuable evidence 
of the candidate s high or low motivation. The ratings of motivation 
given in this situation correlated ,43 (in Period G) with the interviewer’s 
ratings. In case of disagreement they were not given very much considera- 
tion: the final ratings of Motivation for Assignment correlated .97 with the 
interviewer’s ratings and only 53 with those given in Post-Stress, Some 
information on the candidate’s war morale as a factor in his motivation was 
obtained from the sentiments he expressed in Discussion and Debate, but 
these data appeared significant only in a small proportion of cases. 

The interviewers, being left almost the sole judges of the candidate’s 
motivation for assignment, made a point of obtaining as clear and detailed 
a picture of it as they could. Since this topic was closely related to the 
candidate’s goals in undergoing assessment and was not so personal as to be 
upsetting, it was frequently used as an opening for the Interview. After 
asking the candidate how he happened to get in touch with the organization 
and what he knew about the assignment contemplated for him, it was 
natural for the interviewer to ask which aspects of the assignment appealed 
to him and which were less satisfactory, why he had decided to accept it, 
if he had, and what he stood to gain and to lose by it. Some interviewers 
pointed out to the candidate that here was an opportunity for him to discuss 
his misgivings and to weigh once more all pros and cons in order to arrive 
at a well-founded and satisfying decision. The explicit discussion of the 
candidate’s motives was not the only source from which the interviewer 
derived pertinent information; the discussion of his past history particularly 
in relation to work, of his emotional attitudes and opinions, of his postwar 
plans, often provided clues about the nature of his motivation in general 
which were helpful in evaluating the specific reasons given by him for 
wanting his proposed assignment. Within this general frame of procedure 
the techniques used to elicit information varied from interviewer to inter- 
viewer, as did also the frames of reference used in evaluating the strength, 
reliability, and effectiveness of different motives. 

, Motivation for Assignment had rather low correlations with other vari- 
ables, as shown in Tabic 3, These data are available only for Period G 
because in earlier periods (B through F) Energy and Initiative was included 
with it as a composite variable. 

Because of the great importance of the problem of motivation it seemed de- 
sirable to make a systematic study of the information obtained in the inter- 
views as well as of the interviewers’ criteria of evaluation. Therefore for a 
period of five months (December 4, 1944, to May 6, 1945) a careful record was 
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kept of the reasons given by each candidate for wanting his assignment and 
of all misgivings that were admitted. It was hoped that in addition to 
determining the proper criteria of evaluation of the different kinds of 
motiveSj the study would also, by tabulating the conscious reasons for 
voluntary participation in the war effort, contril)iUe to the general prob- 
lem of “drives toward war.” 

TABLE 3 

Correlations between Motivation for Assignment and Other Variables 

{Period G) 

Social Relations 45 Security 23 

‘Energy and Initiative 44 Effective Intelligence 22 

Emotional Stability 43 Physical Ability 22 

Leadership 36 Observing & Reporting 18 

Propaganda Skills 35 

The study was conducted by means of a check list which included all 
motives for wanting an assignment which interviewers remembered as 
having been given by the candidates who up to that time had passed 
through S, as well as all misgivings expressed by them. The form also 
included a list of statements in terms of which the interviewer could indi- 
cate the strength of the candidate’s desire for the assignment, the nature 
of his first contact with the organization, and the extent of his orientation 
about his assignment. The interviewers were asked not to change their usual 
procedure but merely to check the lists immediately afterward, indicating, 
on the basis of memory and notes, what motives and misgivings had been 
elicited during the discussion of the candidate’s motivation. They were also 
at liberty to check motives which were not explicitly formulated by the inter- 
viewees, but which could be deduced with a fair amount of certainty from 
what they had said. If several motives were mentioned by the candidates, 
the interviewers were asked to double-check one or more motives that 
appeared to be of primary importance. Multiple motives were admitted in 
77 per cent of all cases. The following form was used : 

MOTIVATION FOR ASSIGNMENT OVERSEAS 
Check List 

Student Name .Class S Interviewer 

Please check the items that fit the candidate’s case. Check all motives and mis- 
givings that were revealed in the interview, double- checking those that appear to 
be of primary importance for the student. (Motives listed under D21-31 are not 
likely to be primary motives.) If the student mentioned a motive that is not 
listed, check items D32, 33, or Eio, respectively, and explain under “Comments.” 
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Any other comments, incUiding characteristic phrases used by the student in 
describing Ins motivation, impressions as to tlie genuineness of the motives triven 
or guesses at real motives should be recorded. Try to get the student to name 
specific motives, not merely state that he wants to participate in the war effort. 

A. GENERAL ATTITUDE: 


1. Does not want to go. 

2. No desire but accqus. 

3. Neutral altitude (no objections). 

4. Ambivalent attitude, 

5. Definitely wants assignment. 

6. EntliiisiasUc about going. 

7. Ready to make substantial sacrifices. 


B. CONTACT WITH OSS: 

1. Actively a])pr()achecl OSS, 

2, Recruited from civilian life. 

3, Recruited from one o[ the services. 

4. Ordered to rc[)ort, 

C. ORimTATlON AUOVr ASSIGNMENT: 

1. Has fairly clear idea of assigiutieiu. 

2. Has only vague idea ol assignment. 

3. Hardly any idea of assignment. 

D. REASONS TOR WANTING AN ASSIGNMENT: 

1. To have tlie job done (get the war over with). 

2. Patriotic (do sometbing for iny country), 

3. right for democracy or peace. 

4. Fight against Nazism^ anti-Semitism. 

5. Fight Gertnuny, Japan (hatred of). 

6. Personal revenge. 

7. Prestige, social recognition (by own children or others). 

8. Sense of duty, conscience, 

9* fo test atjd prove oneself, 

ro. Personal development (attain maturity, independence), 

11. Paiiicipiuiou (in ciimnmn f.xpcriciuc, in .significant events of the time). 

12. Broadening c.K[)erienees (travel, etc.). 

13. I^xcitcmetit, adventure. 

14. Professional cxperitrnce, career, 

15. Desire lor particular type of work (e.g,, active assignment, leadership). 

16. Desire for work in given country. 

17. Financial ktienneiit. 

18. Escape from undesirable work. 

19. Escape from more dangcTous assignment. 

20. Escape from personal problems. 
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Personal cjualifications for work.: 

21. Ability ior responsible, irulepentlcnt, organizational work; IcadcrsKip, 

22. Possession of patticiilar skills, knowledge, experience. 

23. JCnowledge of country, language, natives. 

24. Good health, strength, 

25. Lack of fear, 'worries. 

26. Freedom from obligations. 

Good reputation of OSS: 

27. Efficiency. 

28. Scope for ability. 

29. Less hierarchical organization, discipline. 

30. Better class of people. 

31. War ends soon, 

32. Other personal motives, 

33. Other social motives. 

34. Other motives related to OSS. 

E. MISGIVINGS ABOUT ASSIGNMENT: 

1. Fear of danger, mutilation, death. 

2. Separation from family. 

3. Giving up o£ work, career, security. 

4. Giving up of comforts, routine. 

5. Obligations — personal and work. 

6 . Religious, ethical misgivings. 

7. Misgivings about war aims and results (lasting peace, etc,), 

8. Fear of not being able to ^^face it.” 

9. Fear of not being able to do the work (lack of skill, etc,), 

10. Misgivings about health. 

11. Fear of loss of prestige. 

12. Fear of subordinate position. 

13. Fear of inadequate leadership, 

14. Fear of routine, not worth while, ineffective work. 

15. Fear of waiting and idleness. 

16. Preference for a different type of work. 

17. Preference for a different war theater. 

18. Desire to know more about assignment. 

19. Lack of confidence in OSS. (Reason?) 

20. Other misgivings. 

F. COMMENTS: 
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Examination of the check list shows that not all reasons listed were likely 
to be equivalent with regard to their potential motivating power in seeking 
an assignment. That those listed under the subheadings Personal Quali- 
fications for Work and Good Reputation, of OSS were by their nature 
subsidiary motives, or complements of other motives, is borne out by the 
fact that items listed under these headings occurred proportionately less 
frequently among the estimated main motives than among all motives 
checked (n per cent and 27 per cent, respectively), 

Apart from this rough division of motives according to whether or not 
they are likely to function as main motives, they can be grouped in various 
equally meaningful ways. We shall not attempt any fixed groupings, but 
in taking up different aspects of the topic shall group the motives in a 
manner that seems best suited for the discussion of each set of results. 

We shall first consider the incidence of different motives in the total 
group studied. This group consisted of 503 unselectcd candidates, all men, 
43 per cent of them officers, 37 per cent enlisted men, and 20 per cent civilians; 
57 per cent were under 30 years of age, 30 per cent between 30 and 40, 
and 13 per cent over 40, The destination of the overwhelming majority was 
FETO. All motives elicited from this group are listed in Table 4, in order 
of frequency of their occurrence; the incidence of motives is given in 
percentages both of the total number of subjects (representing proportions 
of candidates naming each motive), and of the total number of motives 
checked by the whole group. The third column gives the percentage fre- 
quency with which the given item was checked as one of the main motives 
in relation to all other motives that were so checked. The rest of this 
section consists of a discussion of the data of this table. 

The most frequent single avowed motive was the desire for an opportunity 
to do some particular type of work which, the candidate hoped, the 
assignment would provide. More tlian a third of all subjects mentioned 
this motive; among the main motives checked, its frequency was 16 per 
cent. This category includes specific wishes, such as the desire of a trained 
pilot to continue flying, the desire of an anthropologist to collect new 
material in the field, or the wish of a man who had received specialized 
training in the Army to apply his knowledge of languages, of intelligence 
work, or of dcmoliiions. On the other hand, the work desired was often 
described in a more general way: active outdoor work, or desk work, or 
interesting, intellectual, stimulating work, and, perhaps most frequently, work 
that is described as important and worth while and provides opportunities 
for responsibility, initiative, and leadership, as well as for full utilization 
of knowledge and abilities. The following statement is representative of 
many: “In nothing else could I use so much of what I have; the work is 
interesting and important, and it fits exactly into my civilian and Army 
background — it is a tie-up all the way through.” 
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TABLE 4 

Incidence of DitlcrciU Mdiivcs in =i(M ('.andidatcs 




of 

.subjects for 
whom motive 

I’cRcotage 
of checks 
givt-n 

Percentage of 
"main 
mucivc" 

Motive 

No. 

Motive 

wMS checked 

(N- 50O'' 

to CA\\\ 
riiotivi* 

(jV 

checks given 

UJ each 
motive 

15 

Particular work 

36.4% 

S- 3 % 

16.1% 

I 

Get job done 

30.1 i 

6.9 

8-9 

8 

Sense of duty 

19.1 

6.6 

8.7 

z 

PatriotisiTi 

17.8 

6.3 

9.8 

11 

Possession of skills 

17.8'’ 

6.3 ‘‘ 

57 ‘’ 

11 

Broadening experience, travel 

11,9 

3.x 

4.4 

18 

Escape from unwanted work 

11.9 

5 -^ 

5-7 

13 

Excitement, adventure 

ig.3 

4,4 

4-1 

2.8 

Scope of ability in OSS 

18.9*’ 

4 ' 3 '' 

c.g*" 

II 

Participation 

18. 1 

4.1 

4.6 

14 

Professional experience, career 

17.3 

3 '9 

44 

3 ^ 

Personal motives, miscellaneous 

16.7 

3,8 

3'5 

2-3 

Knowledge of country, language 

16.7^’ 

3.8'' 

1 . 5 *’ 

7 

Prestige, recognition 

14.1 

3.L 

3‘3 

16 

Work in particular country 

IX. 7 

X.9 

1.6 

M 

1 Good health 

IX.l'’ 

X.8'’ 


3 

Fight for democracy 

II.3 

X.6 

1.4 

XI 

Ability for responsible work 

10,1*’ 

X.3 *’ 


4 

Fight Nazism 

7-9 

1,8 

14 

17 

Efficiency of OSS 

7.9'’ 

1 . 8*’ 


xg 

Less hierarchy in OSS 

7.0^^ 

1.6*’ 

0.1^ 

15 

Lack of fear 

7.0^ 

1. 6*" 

0.4^ 

9 

Test oneself 

6.4 

1,4 

1.5 

3 

Fight Germany, Japan 

6.1 

1.4 

1*3 

10 

Personal development 

5.8 

i '3 

^•5 

30 

Better people in OSS 

4 . 8 *’ 

1 . 1*’ 

04^ 

17 

Financial betterment 

4.0 

0'9 

1.0 

i 6 

Freedom from obligations 

3.6^’ 

0.8*’ 

b 

xo 

Escape from personal problem 

3‘4 

0.8 

04 

19 

Escape from more dangerous work 

3 »x 

0.7 

0,6 

6 

Persoiiarl evenge 

1,8 

0.6 

0,1 

33 

Social motives, miscellaneous 

1,0 

0.4 

04 

34 

Other motives related to OSS 

1,8*^ 

0.5*’ 

0.1^ 

31 

War ends soon 

i.o'^ 

0,4^ 



‘The figures in the first column add to more than ioo% because the same subjects appear 
in different categories. 

‘‘Motives falling in the category of “Subsidiary’* (Motives Nos. 21 — 31 and No. 34) 
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Depending on the special nature of the activity and on the meaning it 
has for the person, the desire for a particular kind of work may express 
widely differing needs in different persons. One can occasionally guess at 
these needs from the remarks of the candidate as set down by the inter- 
viewer. Thus the man who voices an urgent wish “to work at full capacity 
and do a really good, well-planned job, not the trifling ineffectual sort of 
thing we did in the Army,” expresses needs that differ from those of one 
who confides that he is after “a not too strenuous job,” and probably 
also from those of one who wants to be given “important work” because 
he feels he “can do it better than most others.” However, such revealing 
comments are rare in the records, and because of its lack of differentiation 
the work-motive category remains psychologically somewhat ambiguous. 
This ambiguity, however, does not invalidate the fact that a large propor- 
tion of our candidates were motivated for their assignment by wishes 
which are integral in their peacetime pursuits and which lack any reference 
to the war as such. Closely related in content to the motive under dis- 
cussion (No. 15) are the follov^^ing: the desire for professional experience 
and advancement (No. 14) (“If I don’t advance in the Army along the line 
of newspaper work, it will be a strike against me later ”) ; the wish to escape 
from undesirable work (No. 18); and the subsidiary motives referring to 
the possession of ability, knowledge, and skill (Nos. 21, 22, 23) and to the 
efficiency and scope of the OSS (Nos. 27, 28). If one adds the percentages 
for all these items listed in Table 4, around 36 per cent of all motives given 
are found to be related to the work aspect of the assignment and the same 
proportion holds for the main motives. Whatever individual needs— achieve- 
ment, recognition, or others — were served by the proposed work, except in 
the rare cases of persons who specifically desire hazardous duty, these 
needs were not satisfied by any situations specific to the armed struggle 
and its objectives or by any activities intrinsically connected with it. Since 
no particular premium is placed on such personal wishes by public opinion 
in wartime, we have no cause to suspect the veracity of our subjects in 
giving these reasons for their desire to join the organization. 

The motive next most often given was the one (No. i) that has become 
familiar to us from the journalistic descriptions of the attitudes of American 
.soldiers toward the war: the wish to have the job done, to get the war 
over with, frequently with the implied or explicit addition— so that normal 
life can be resumed, expressed variously as: “Anything I can do to get it 
over with soon, naturally I want to do it.” “Of course I would rather go 
home, but the job is not done ” “We have to get the war over with and 
come back to normal life again,” Unpretentious as these formulations are, 
they probably represent for our group of volunteers the main channel of 
expression of socially oriented motivation. For these men the job to be done 
was felt as a common task, a situation to be cleared up in common, which 
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concerned them as a matter of course, because of their belongingness with 
others, regardless of whether or not the war had affected them as indi- 
viduals. Closely related to this most typical sociocentric motive was the less 
frequently expressed desire for participation in the common experience and 
common fate (No. n). This desire was expressed with particular intensity 
not by men who were secure in their feeling of belongingness, but rather 
by those who felt isolated and who struggled to bridge the gap between 
themselves and others; thus in some extreme cases this motive may repre- 
sent a lack rather than a secure possession of social bonds, but it is still 
predominantly social in its orientation; it is similar to the occasionally ex- 
pressed wish to remain with a group of people of which one has become 
a member (No. 33) . 

Other sociocentric motives which occurred almost as frequently as the 
desire “to have the job done” were those of duty and patriotism (Nos. 8, 
2). The expressions of the latter varied from a simple mention of the 
motive (“I guess I am as patriotic as the next guy”) and of a wish “to do 
something for my country” to occasional use of patriotic stereotypes and 
formulations that invoke the family tradition of serving the state. The ex- 
plicit formulations seemed to be more typical of immigrants and of mis- 
sionaries. In some cases patriotic sentiments went hand in hand with more 
concrete expressions of identification with a group: “As an American I 
feel great obligations to my country. I hate to see our boys there in China 
without the information I could give them,” In many cases the patriotic 
motive was almost indistinguishable from the desire to help do the job, 
the only difference being the more explicit reference to the social organism 
— country— that is faced with the job. 

The motive based on the sense of duty is here considered as a sociocentric 
one only for the sake of rough grouping, since in this case the participation 
in a common task or fate serves the purpose of maintaining individual 
standards of behavior, with personal conscience as their sanction: “I could 
not live with myself if I would not join.” “My conscience docs not allow 
me to stay in this place in safety ” Often, however, the duty motive appeared 
in a milder, less extreme form which permitted an integration with other 
social motives: “Within the Army a fellow has not done his part if he has 
not been overseas.” “I feel it is my turn now to relieve others.” 

One conspicuous finding, and one that has been repeatedly made in 
studies of wartime attitudes, was the rarity of motives based on specific 
ideology. Only xi per cent of our subjects mentioned the fight for democracy 
or peace as one of their goals, as contrasted with the 30 per cent who 
merely wanted “to do the job,” without specifying its ultimate meaning. 
Among the items checked as main motives, 23 per cent were found in the 
relatively unspecific categories of “job done,” “participation,” and “patri- 
otism,” and less than 5 per cent in those of “fight for democracy,” or 
“fight against Nazism” (Nos. 3, 4), It is, of course, conceivable that the 
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incidence of ideological motives was higher among earlier groups of candi- 
dates assessed foi tlie European campaign. Still less frequent were motives 
that represented expressions of aggression, without so much ideological foun- 
dation, such as hatred of the Germans or of the Japanese (No. 5) and a 
desire for personal revenge for wrongs or losses suffered (No. 6). 

If the percentages listed in Table q for the predominantly sociocentric 
motives discussed above, including duty, ideology, and group aggression are 
added, it is found that they form 30 per cent of all motives checked, and 
38 per cent of the main motives. Thus motives centered around the war 
as a situation of common concern were no more prominent in the group 
studied than motives related to individual achievement in work. 

The remaining categories cover personal egocentric motives other than 
those concerned with work. They express various needs of the person 
which can be satisfied by some aspects of the war situation, but like work 
motives they have little inherent connection with the nature and purpose of 
war. The most frequent among them was the desire for travel and for 
broadening experience in general (No. 12) which was mentioned by 23 
per cent of our subjects. The wartime work was seen by them as a welcome 
opportunity to extend their horizon and to see the world: “There was never 
a cheaper trip.” Closely related to this motive was the almost equally fre- 
quent desire for excitement and adventure (No. 13): “There is also a 
little glamour that goes with secret work; I always loved detective stories.” 
Much less frequent were the motives which explicitly stress the theme of 
personal development which is at times implied in the wish for broadening 
experience; the desire to progress in the direction of maturity, manliness, 
courage, independence or to test and prove one’s attainments in these 
spheres (Nos. 9 and 10). “Such an experience helps one to find oneself,” 
The subsidiary motive referring to a great freedom from regulations in OSS 
(No. 29) often had similar connotations. All together the motives having 
to do with gaining enriching experiences listed above formed 12 to 13 per 
cent of all motives checked, as well as of the main motives. 

The motive of prestige, of social recognition to be obtained from an assign- 
ment overseas (No. 7), was checked for only 14 per cent of all candidates, 
and more frequently than in the case of other motives it was checked as 
merely inferred by the interviewer. Erom this, as well as from the apologetic 
remarks frequently accompanying the expression of this motive ("I know it 
is mainly selfish"), one may suspect that it was present more frequently 
than admitted. When explicitly formulated, the need for prestige was often 
expressed In reference to one’s family or children, or to one’s friends and 
colleagues. "My family will be proud of me”; “I want to be able to tell 
my children and grandchildren that I did not sit here during the war”; 
“My friends are all officers now, scattered all over the world; when they 
come back they ask you, where have been?” “I spent the last war in 
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this country, while others went abroad; I atn ashamed not to have rib- 
bons on my Marine uniform." Tlic dcvsirc to joiii the argaiu?:ation because 
of the “better class of [)eoplc“ one wraild meet in it (No. 30) is closely 
related to the motive of prestige and status. 

The desire for financial betterment, for material gains expected from 
joining the organization (No, 17) was statctl, (fr inferred, in only 4 per cent 
of all cases. Although this motive may not always have been frexly admitted, 
the impression was that when present, hut not niciuionctl, it was more 
often a contributing than a determining factor of mutivatkm. There were 
very few men whose particubar and rather exccptiui\al circumstances made 
them consider the assignment as a way of tiding them over the war, or as 
a means of solving their financial problems. More often, perhaps, the reputa- 
tion of the organization as having high priorities and giving people good 
breaks was one of the inducements to join for the enlisted men: “IE you 
want anything in the FETO—whiskey, stcaks^— go to the OSS," 

While the egocentric motives so far discussed seem (m the \sdiole to repre- 
sent strivings for positively defined personal goals, one small l)ut conspicti- 
ous group of motives was characterized by the <lirecuon away from some 
negative state; escape from what was thought to be a more dangerous 
assignment in the Army (No. 19), or escajie from personal problems, such as 
a difficult marital or vocational situation, or rither unsolved conflicts (No. 
20). The much more frequent motive of escaping undesirable work (No. 
18) can also be put liiio this category of negative, “egressive” motives, 
although in some cases the negative fcirmulation seemed to be merely 
verbal, the freely expressed desire to escape a monotonous unjH’oductlve 
job in the Army being merely a counterpart of the positive motives related 
to work. 

Motives listed under Other Personal Motives (No, 32) consisted largely 
of specialized personal wishes that do not fit into any of the other categories, 
They can also be considered as egocentric. All egocentric motives not re- 
ferring to work, taken together, form 25 per cent of all motives checked, 
and 22 per cent of the main motives. Idie 25 per cent for egocentric 
motives is to be compared with 36 per cent for motives related to work, and 
30 per cent for socioccntric motives, The remainder consists of motives, 
mostly subsidiary, with no clcar-cut general connotations, such as desire to 
work in a particular country, and the possession of qualificationvS not 
clearly related to specific goals, such as health, lack of fear, and freedom 
from obligations. 

In summary, the outstanding finding is the extreme infrequency in the 
group studied of the ideological motives, and the relative infrequency of all 
motives directly connected with the war and its expected outcome (Nos. 
^“ 5 )* Only 25 per cent of all motives checked as main motives fall into 
these categories. Forty-eight per cent of our candidates did not mention 
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any of them, not even as contributing motives. On the other hand, the 
percentage of those who did not mention any motive related to work is 
merely 21 per cent. Foi a group of volunteers whom, by comparison with 
the total population, we considered to be highly motivated for participation 
in the war effort, this is a striking result. It would seem that many people 
in the United States are drawn into modern war mainly because it offers 

TABLE 5 

Incidence of Main Groups of Motives 


Percentage of Percentage of 

all motives all "main 

checked motives'.' 

(N= 2.109) (^==459) 

Work motives 

Sociocentric motives jo 38 

Egocentric motives 2.5 xx 

Others a 


them a chance to do effective work in their own field, using their skills and 
abilities, seeing immediate results, and advancing along their professional 
lines, i.e., for reasons that have little to do either with aggression or with 
any group ideologies. 

The purposes and so the composition of the OSS provide a partial ex- 
planation of the high frequency of the work motives. The OSS recruited 
hundreds of trained specialists. Our population of candidates therefore con- 
tained a much larger percentage of professional workers than the United 
States census population, and at the time of our study it was composed 
largely of military personnel.^ The candidates had been presumably selected 
from the more active and ambitious, and the combination of their pro- 
fessional aspirations with the frequent situation of finding themselves in a 
routine job in the Army may have enhanced their desire for more adequate 
placement, However, in so far as the disruption and delay In the carrying out 
of personal plans, often at a period of life crucial for their inception, are 
typical for the situation of the majority of draftees, our findings are prob- 
ably fairly representative of the American age group that was called upon 
to bare the brunt of this war, 

The limitations of our data may also have influenced our findings about 
the incidence of various motives. The interviewer did not, as a rule, syste- 
matically inquire after all possible motives; some of them checked, on the 
average, more motives per candidate than did others. Our method, while 
it had the advantage of not suggesting answers to the subjects, may well 
have been responsible for overlooking some of the motives which the 

^For a detailed description oE the assessed population see Appendix A-i, pages 498-501. 
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candidates may have taken for granted, such as patriotism or the simple 
desire to “have the job done and over with.” Furthermore, the psychological 
ambiguity of the work motives makes it a likely vehicle of such unexpressed 
motives, and some of the remarks that were noted indicate that this was 
sometimes the case. Thus the desire to work at full capacity was occasionally 
related to a wish to be most useful or to make a worth-while contribution, 
and these expressions suggest a closer relation to the war situation than was 
inherent in the work motives as such. It is even conceivable that some o£ 
the candidates refrained from mentioning any but individualistic motives 
out of the feeling that any avowal of patriotism or of loyalty to an institution 
might be regarded as indicative of sentimentality, stupidity, or hypocrisy. 
In spite of all these qualifications the data still seem to warrant the con- 
clusion, or at least a fair guess, that very many people volunteered for OSS 
work primarily because of their interest in a special job, rather than because 
of their interest in “the job to be done”: a finding which reflects the cultural 
sanctioning of the individualistic sentiments that has been for some time 
prevalent in the United States. 

Evaluation of Motives.— The question that is of importance for assess- 
ment is the relative value of the different motives described above for ensur- 
ing an optimal performance in an overseas assignment. A decisive answer 
to this question could be given only on the basis of dependable reports 
about the motivation on the job and the performance overseas of the 
candidates whose motives had been adequately ascertained during assess- 
ment. Unfortunately, such reports were available for only a small percentage 
of the subjects of the special study, and, like our appraisal material in 
general (cf. Chapter IX), they were far from complete and reliable. We can 
make little use of these appraisal data but can approach the problem only 
indirectly, by trying to find connections between various types of motiva- 
tion and various desirable and undesirable characteristics of candidates re- 
vealed in assessment and expressed in the ratings of variables. The fields 
in which such relationships may be expected to be found arc emotional 
stability and social relations, since they represent significant aspects of the 
dynamisms involved in the formation of the concrete motives of a person, 
We therefore compared the motives of the candidates who received high 
scores (4, 5) on the final rating of each of these two variables with the 
motives of those who received low scores (0, i), In addition, and by way 
of a check, we made this comparison also for candidates of high and low 
Intelligence— the general variable which is assumed to be relatively inde- 
pendent of individual dynamics. 

As a point of comparison we used the frequency of occurrence of the 
various single motives included in the check list, as well as of groups of 
motives of similar nature. These frequencies were computed for each high 
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and low group and expressed in terms of percentage of the total number 
of motives checked for each group. The significance of the differences was 
tested by means of the critical ratio, 

EMOTIONAL STABILITY.— Wc shall first Compare the groups characterized by 
high and low Emotional Stability, Table 6 gives for these two groups the 
incidence of motives classified as described above. There are 92 subjects in 
the high group and 65 in the low. N refers in this, as in subseejuent tables, 
not to the number of subjects, but to the number of all motives checked for 
each group. 

Motives related to work, taken together, occur with about equal fre- 
quency in the high and the low group, and the same is true of several 
single items of this complex of motives, such as desire for particular work, 
desire for professional advancement, and desire for assignment based on 
possession of special skills or knowledge. On the other hand, the wish to 
escape from undesirable work is four times more frequent in the unstable 
group, and the desire for assignment justified by possession of ability and 
leadership is four times more frequent in the stable group. The other differ- 
ences with regard to single items arc not statistically significant, but the 
stable group tends to value more highly the efficiency of the organization and 
the scope for initiative it affords the individual, motives closely related 
to the feeling of having something to offer, 

TABLE 6 

Incidence of Different Motives in Groups of 
High and Low Emotional Stability 



High Emotional 

Low Emotional 



Srability (4^5) 

Stability CO|i) 

CR 


450) 

C)'r=M8) 


Motives related to work. . , 

34 - 1 % 

357 % 

— 

Socioccntric motives 

354 

19.0 

1.8 

Egocentric motives 

19.6 

30.0 

3.0 

Other motives 


5-3 

' — 


The complex of socioccntric motives differentiates slightly between the 
two groups in favor of the emotionally stable men. There is no difference 
between the groups in the most frequent single motive— the wish to ^'havc 
the job done.’* There are, however, differences which arc significant at the 
5 per cent level in the ideological motive to fight for democracy and in the 
desire for participation, both of which arc more frequent in the stable 
group, as is also the motive of patriotism. The motive of duty, on the 
other hand, which cannot be considered as a socioccntric motive in the same 
sense as the others, is more frequent in the unstable group. If this motive 



250 


Assessment of Men 


is excluded from the sociocentric complex of motives, the critical ratio of 
the diflerence between the two groups rises to 2.7. 

The motives that discriminate most clearly between the stable and tlie 
unstable subjects are the egocentric ones. They are present signiikantly more 
frequently in die low group than in the high. Unlike the first two cate- 
gories, this complex of motives has a greater dillcrentiating power tlian 
does any of its single items. I'he only two of them that yield differences 
approaching statistical significance are the desire to test and prove oneself 
and the category Other Personal Motives, both of which are more frequent 
in the unstable group. To a lesser extent the same is true of the motives 
of prestige, financial gain, and the wish to escape from danger and from 
personal problems. Of eleven items making up the egocentric complex 
of motives, only the desire for adventure and the hope of obtaining a 
greater freedom from regulations in the OSS have a greater freciuencv in 
the stable group, i r 

Although the complexes into which we have arbitrarily divided the 
motives do differentiate between the groups of subjects of different emo- 
tional stability to a certain extent, the fact that some of the single items in 
two of these complexes are much more diagnostic than the complexes 
themselves suggests that this classification is not the most pertinent one for 
emotioiial stability. In particular the motive of duty shows a direction of 
discrimination different from the rest of the social motives, and within 
the other two complexes, motives concerned with the possession of abilities 
and with desire for adventure also show a different direction of discrimina- 
tion from those concerned with career, prestige, finances, and escape, In 
addition, the three subsidiary motives, not included in any category-posses- 
sion of health, freedom from fear, and freedom from obligations— are 
more prevalent in the stable group, the differences being statistically 
significant for the first two items. All of these observations suggest a re- 
clustering of the egocentric motives, including some of the work motives, 
into (1) the expansive motives, reflecting self-confidence, and into (ii) those 
that can be interpreted as concerned mainly with security, regardless of 
w et er t ey stress escape, or striving for self-re.spect, or striving for status 
ase on prestige and money. Table 7 gives the incidence of the motives 
thus reclustered in the groups of high and low emotional stability. The only 
motives rom t e original complexes that have not been included in this 
new classification are some of the work motives, the psychological nature 
o w 1C is not clear: these include the desire for particular work, the wish 
o use particular skills, or to work In a particular country, as well as the 
category of Other Personal Motives.^ 

lw7mLv« to 

unstable group, as are also Othe" kTs^al Modv^^ 
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The table shows that motives related to escape, self-respect, and status, 
taken in their totality, are diagnostic of the group of low emotional stability, 
whereas motives aiming at activity and new experience, and reflecting a 
self-confident feeling of ability and well-being are typical for the group of 
high emotional stability. The subgroups that have the greatest differentiating 


TABLE 7 

Incidence of Reclassified Motives in Groups of 
High and Low Emotional Stability 


High Ema clonal 
Stabilicy (4,5) 
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Low Emotional 
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Ability motives (Nos, zi, zy, z8) ii.6% 5.6 

Positive self-feeling (Nos. 14, 15, x6). ... 7.3 i.z 

Expansive motives (Nos. 10, iz, I3,X9). .1^5 9.6 

All motives exfressinj!^ sc If -con ft (knee 32-4% 

Escape motives (Nos. 18, 19, xo) 1.6% 

Status motives (Nos, 7, 14, 17, 30) ^.8 ii.z 

Self-respect motives (Nos. 8, 9) 7.5 iz.i 

All motives expressintf^ htsocurity 15*9% 

Sociocentric motives (Nos . i , 3 3) z8 . 9 

Aggressive motives (Nos, 5, 6) z.6 

All other motives zo, i 


3*3 

4'-3 

i.z 

16.4% 5.Z 

4-5 

Z.4 

1*9 

35 - 8 % 

zo.i Z.7 

0.8 1.9 
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power are those concerned with escape and with the positive self-feeling. 
This self-confident feeling of the emotionally stable group often results in 
motives that are relatively unspecific, as compared with the many clearly 
defined single goals of the emotionally unstable, such as prestige, financial 
gain, escape from concrete situations, or desire to work in a particular 
country. As one subject put it: “I don’t know myself exactly why [I want the 
assignment] : perhaps one might call it adventure. It is just that I am young 
and active and like to see things done.” In this connection it is interesting 
to note that the misgivings sometimes felt by the staff about the emotional 
stability of people expressing the desire for adventure are not confirmed 
by our data. The adventure motive proved more typical of the group of high 
emotional stability than did cither of the two related but more “self- 
conscious” motives: the desire for broadening experience and the desire 
for personal development. These latter arc the only two items among the 
reclustercd motives chat show no appreciable difference for the two groups 
of subjects. 

As was mentioned before, the possession of genuine sociocentric motives 
is characteristic of the group of high emotional stability, although less so 
than the expression of self-confident attitudes. 
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In evaluating the significance of these findings one nnust consider the 
possible sources of error inherent in the fact that the same person— the 
interviewer— who checked off the specific motives of the candidate was also 
the main judge of his emotional stability as indicated by the final score, 
One might suspect that, according to his own conceptions of emotional 
stability, or of desirable motivation, he might almost unwittingly be in- 
clined to view one set of data in the light of the other and to adjust them 
to each other, thus bringing about the relationships discussed above. 
On closer inspection, however, the possible extent of such adjustments 
appears negligible. In recording the motives the interviewers usually did no 
more than check oif the items mentioned by the candidate; while they 
could, by dwelling on the topic of motivation, increase the number of 
motives named, they usually refrained from asking suggestive questions, 
and did very little guessing or interpreting, except in a small proportion of 
cases which were marked as inferences. Therefore the results recorded in the 
check list may be considered to be relatively Independent of any opinions 
held by the interviewer about the candidate’s emotional stability or any 
other of his characteristics. On the other hand, the interviewer's rating of 
emotional stability might have been influenced in some cases by the type of 
the motives revealed by the candidate, as, for instance, by the prevalence of 
escape motives. It must be remembered, however, that data pertaining to 
motives were only a small and by no means the crucial part of the evidence 
on the candidate’s emotional stability, since a large amount of material on 
his past history, his emotional attitudes, and symptoms of maladjustment 
was at the disposal of the interviewer. Futhermore, except with regard to 
a few types of motives, such as escape motives, there were no preconceptions 
among the interviewers as to which motives were indicative of high and 
which of low emotional stability. For these reasons the ratings of emotional 
stability and the checks of specific motives are probably not dependent on 
each other to an appreciable extent. Thus we may assume with a fair de- 
gree of certainty that the relationships which were found to exist between 
them did not result from any technical artifact but reflect inherent dynamic 
interrelations. 


SOCIAL RELATIONS. ^Tablc 8 shows the incidence of the motives in the various 
categories already described among those candidates who received high and 
low final scores on Social Relations, There were 6i subjects in the high 
group and 58 in the low. 

greatest difference between the two groups of subjects was in the 
incidence of the sociocentric motives which, as might be expected, was 
iigher in the group with high social relations. This difference, although not 
striking, is greater than the difference that was found to exist between the 
sociocentric motives of the groups characterized by high and low emotional 



253 


Assessment at S: Analysis of Variables 

stability. Ihe greatest differences were found in the items referring to 
getting the job done, the light for democracy, patriotism, and participating 
in the war. The motive of duty occurred with approximately equal fre- 
quency in both groups. If this motive is not included in the sociocentric 
complex, the differentiation of the two groups becomes even more marked. 
Work motives and egocentric motives are then slightly more frequent in the 
low group, the difference being most marked in the items referring to 
career, financial gain, and possession of skills* On the other hand, refer’- 
ences to ability, health, and desire for adventure are more frequent in the 
high group. On the whole, however, the single items do not differentiate 
the two groups very clearly, nor do such differences as exist suggest any 

TABLE 8 

Incidence of Different Motives in Groups of 
High and Low Social Relations 
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principles for a more pertinent clustering of items. Complexes of motives 
that were found to differentiate between the subjects of high and low 
emotional stability yield no such clear-cut differences for the subjects with 
high and low social relations, although the ''positive self-feeling” motives 
were more common in the high group, and the "status” motives in the 
low one. The incidence of sociocentric motives remains the one clear- 
cut differentiating characteristic* Since Social Relations was rated largely 
on the basis of situational tests, with the interviewer being only one of the 
raters, this relationship is not likely to be a result of any interpretations or 
biases of the examiners. 


EFFECTIVE iNTF.Li.ifiENCE.—Tablc 9 coHtains a comparison of the motives of 
candidates of high and low intelligence. 

The groups of high and low intelligence do not differ at all with regard 
to the major complexes of motives, This finding would be in line with 
expectations if our definition of intelligence had been equivalent to the 
goodness and speed of the functions that operated in responding to an 
intelligence test, because intelligence so defined is relatively independent 
of personal dynamics* In the assessment program, however, we were at- 
tempting to determine not so much abstract test intelligence as the practical 
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or effective intelligence which shows itself in successful dealings with all 
aspects of environment, including the social, and which can hardly be con- 
ceived of as an entity apart from the other aspects of personal adjustment. 
One might expect, therefore, that a more detailed examination of the 
motives of the groups characterized by high and low intelligence would 
reveal differences similar to those existing between the groups that were 

TABLE 9 

Incidence of Different Motives in Groups of 
High and Low Intelligence 

High Intelligence 

C4.5) 

• (N=4S7) 

Motives related to work 34^8% 

Sociocentric motives 31.0 

Egocentric motives ii.o 

Motives related to ability, 

career, prestige 10.4 

All other motives 0.8 

high and low in Emotional Stability and in Social Relations. This is actually 
the case.^ The escape motives in particular, which provided the best single 
differentiation between groups varying in Emotional Stability, also differ- 
entiated significantly between the groups varying in intelligence, the group 
of low intelligence mentioning these motives twice as frecpcntly as the 
group of high intelligence. The motive of duty was also somewhat more 
frequent m the less intelligent group, whereas motives pertaining to ability 
Were more common among the more intelligent. 

There was no difference between the intelligence groups, however, in re- 
gar to motives expressing positive self-feeling and expansive desires. The 
status motives differentiated between the groups in the direction opposite to 
that obtaining in the groups differing in Emotional Stability and Social Rela- 
tions: the more intelligent men were more concerned with prestige and pro- 
fessional career (but not with finances) than those of lower intelligence. They 
were also slightly more involved in their work: if one exclude, s from the com- 
plex of work motives the desire to escape from undesirable work, which was 
ess t an alf as frequent among the intelligent as among the lc.ss intelligent 
candidates, the work motives show a somewhiu higher incidence in the 
case of the more intelligent group. The examination of single items of this 
complex reveals an interesting difference between two subsidiary motives. 
While the mention of the possession of abilities was typical of the intelli- 
gent subjects, the reference to particular skills, knowledge, and experience 
as a motive for wanting the assignment was somewhat more frequent 
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among the less intelligentj although there is no reason to assume that the 
actual incidence of such qualifications was higher in this group, An anal- 
ogous diflerencc in the direction in which these two items differentiate 
between the high and the low groups was found also for groups differing 
in Social RclationSj while for groups of high and low Emotional Stability, the 
skill motive— unlike the ability motive— failed to differentiate the two 
groups* This difference between the two motives is the more striking since 
they are closely related in content and were actually mentioned in the same 
breath by a number of candidates. Apparently, however, their connotations 
are not the same. While reference to ability to do responsible work reflects 
a confidence based on actual accomplishment, a readiness to handle new 
situations, and a feeling of being able to contribute to a common goal, the 
reference to possession of specific skills and knowledge seems to indicate a 
cautious clinging to acquired assets as means of compensating for felt 
inferiorities and of providing the person with an adequate niche. Thus 
an overemphasis on the possession of specific qualifications must often be 
considered as an expression of a person’s insecurity and of his feeling of 
being able to contribute not because of what he is, but because of what 
he has. 

The complex of sociocentric motives, if one excludes from it the motive 
of duty, occurs slightly more frequently in the more intelligent group, but 
not significantly so. The motive of participation is the only one that yields 
a significant difference. The ideological motives arc slightly more common 
in the more intelligent group — the fight against Nazism more so than the 
protection of democracy— while patriotism is mentioned more frequently 
by those with lower intelligence. 

In summary, the group with high intelligence was marked by motives 
concerned with ability, professional career, and prestige, as well as by the 
infrequency of the ^*escape from work*’ motive. The combination of thfi 
first three motives differentiates this group significantly from that of lower 
intelligence. For the rest, the intelligent group showed a slight tendency to 
favor the same motives that were found to be typical of people of high 
emotional stability and of high social relations. 

We now have the data for a tentative answer to the question as to what 
motives and clusters of motives have a positive or a negative value as indi- 
cators of high or low emotional stability, good or bad social relations, high 
or low intelligence. Motives that are positive on two or on all three of 
these counts are the sociocentric motives, as well as the motives referring 
to ability and those expressing a strong positive self-feeling. Motives that 
are predominantly negative are the egocentric ones, particularly those that 
express escape wishes, and desire for status. Motives not included in these 
categories either do not differentiate at all between the high and the low 
ends of the , various scales, or appear positive from one point of view and 
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negative or neutral from another. Thus the desire to test and prove one- 
self is indicative of low emotional stability, but it is not infrequent among 
people with high social relations, and does not at all differentiate between 
varying degrees of intelligence. There is a general tendency, however, for 
the positive and negative motives to be positive and negative throughout. 
Whenever an exception to this rule is found it is the relationship to Emo- 
tional Stability that should be weighed heaviest, because as our results have 
shown, the various motives are related to this variable more significantly 
than to any of the others. 

EVALUATION BY iNTEitviEWEKs — The questioH afiscs whether the interviewers, 
in rating the candidates’ Motivation for Assignment, placed on the various 
motives the differential values suggested by these findings, or whether they 
used different criteria of evaluation, each displaying his own personal bias. 
We can answer this question by comparing the motives of the candidates 
who were given high ratings on Motivation for Assignment with those who 
obtained low ratings. Most of the interviewers, on being questioned, agreed 
that the scores they gave did not refer merely or even mainly to the strength 
of desire for assignment as expressed by the candidate verbally or as dem- 
onstrated by his active efforts to obtain an assignment, but rather repre- 
sented a judgment of the ‘‘goodness*’ — the soundness, effectiveness, and 
reliability— of his motivation as extended into the future. The ratings, there- 
fore, must have been based largely on the types of motives revealed by the 
candidates, and consequently must reflect the interviewers’ evaluations of 
these motives. In addition to this objective check, the Interviewers were also 
asked for an explicit formulation of their criteria of evaluation of various 
motives. Since these opinions could not be obtained from all interviewers, 
and since they were collected in a rather unsystematic way, months after 
the completion of the assessment work, they will be used merely to elucidate, 
when possible, the statistical findings. 

Table lo contains a comparison of the groups rated as high and low in 
Motivation for Assignment in respect to the incidence of all motives or 
clusters of motives that were found to differentiate between the extremes 
of one or more of the three variables discussed above. Because of the skew- 
ness of the distribution of the scores on Motivation there are i/\/\ subjects 
in the high group and only 35 in the low. 

^ All clusters of motives listed discriminate between high and low Motiva- 
tion in the same direction in which they discriminated between high and 
low Emotional Stability and high and low Social Relations, but more strik- 
ingly so. This indicates that the interviewers’ evaluations of the various 
motives were congruent with the actually existing relationships, as far as 
we were able to ascertain them on the basis of the data obtained in as- 
sessment. There was, however, among the single motives one. instance of 
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discrepancy. The desire for work in a particular country appears to have 
been positively evaluated by the interviewers, probably because it was felt 
to incrcavSe the candidate’s interest in his specific assignment: it was checked 
for none of the subjects whose Motivation was scored as low. However, for 
some undetermined reason or reasons, this motive was voiced somewhat 
more frequently by candidates who were rated low in Emotional Stability, 
Social Relations, and Intelligence than by those placed at the upper end of 
the scales. Apart from this one specific item, the only bias which is re- 

TABLE 10 

Incidence of Different Motives in Groups of 
High and Low Motivation*^ 



High Motivation 

Low Motivation 



(4. 5) 

C0| i) 

CR 


CN« 77 o) 

(N= 108) 


Work motives 

34 - 7 % 

42-5% 

1.6 

Sociocentric motives 

31,0 

17.4 

3.6 

Egocentric motives 


37.8 

3-3 

Ability motives 

10.4 

4.6 


Positive scif-feeling 

7-4 

1.8 

3'5 

Expansive motives 

13-4 

II. I 


Escape motives 

4-3 

14.8 

3.0 

Status motives 

7-1 

^ 7-5 

1.8 

Self-respect (duty) motives 

7 -S 

9 - 2 - 


Ideological motives 

5-9 

0.9 

4.0 

Aggressive motives 

3-5 

0.9 

2-3 

■ since this table includes two 

different classifications, in 

some cases one motive may 

come 


under two headings. 

fleeted in the interviewers’ comments, and partly in the ratings which they 
gave, is the overvaluation of the ideological motives. Many of the inter- 
viewers, while recognizing the infrequency of this kind of motive, still 
felt that fighting for a cause, when based on a clear insight into the issues 
at stake, provided the most reliable motivation for war work, and deserved 
the highest score. They may have been right, but our material, though it 
places thcsSC motives in a positive category, contains no data that could con- 
firm or disprove the high claims made for them. On the negative side there 
was a general agreement among the raters that escape motives were undesir- 
able, being indicative of maladjustment, and that an exaggerated drive for 
credit and acclaim was a distinct danger. There was more disagreement on 
the rest of the egocentric motives. While some interviewers considered the 
desires for experience, adventure, and advancement as perfectly sound and 
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acceptable, others held them in suspicion and pointed out that if the situa- 
tion ^overseas did not come up to expectations in these respects, the candi- 
date’s modvation would collapse, unless it were supported by other less 
individualistic motives. With regard to the motive of duty there was no 
disagreement among the interviewers, but their evaluation itself was a 
qualified one. It vvas felt that the sense of duty provided an adequate 
motive “up to a point,” that is, when it was not extreme and when it was 
accompanied by an appropriate amount of self-respect based on the man’s 
proved ability to live up to his own standards; if expressed with great 
intensity by a person who had many unsolved personal conflicts, it wL 
viewed as a sign of neurotic involvement and consequently rated down. 

This qualified statement brings up a point which was emphasized by the 
majority of the interviewers questioned, and which serves to limit the 
validity of their own generalizations. In considering the value of various 
motives they felt that hardly any motive could be judged as good or bad 
in Itself, and that each had to be evaluated in terms of its significance for 
the individual person and its appropriateness to his personality structure. 
Thus an enthusiastic desire for activity and adventure was felt by some to 
be appropriate to vigorous young men, but a suspicious sign in older 
and more experienced candidates. Similarly, It was felt that people of high 
intelligence and of good educational background should give more evidence 
of a rational or ideological foundation for their war morale than people 
without such advantages. Energy and Initiative, persistence, temperament, 
ambitious ideals,^ social feeling, group identification, and, most frequently, 
patterns of emotional attitudes,— these and many other factors were quoted 
by different^ interviewers as points to be considered in deciding how the 
specific motives of an individual candidate should be evaluated. 

Care was taken to ascertain not only how deep the desire for an as.sign- 
ment went in a person, but also how wholehearted it was. For this purpose 
the interviewers tried to elicit all of the candidate’s misgivings or counter- 
motives, and to determine their potential significance in creating an ambi- 
tendent attitude toward the assignment.® On the other hand, there was the 
question to consider as to whether different positive motives, when they coexist 
in one person, mutually strengthen or weaken each other. The interviewers 
were not questioned systematically as to whether they considered one strong 
motive as a better source of motivation than a multiplicity of motivc.s, and 
rom the few remarks gathered, it is doubtful whether they had any strong 
opinions on this subject. However, they checked a larger number of motives 
for subjects whom they rated high in Motivation than for those whom they 


* The misgivings most frequently recorded by the interviewers were, in order of frequency, 

?ot of physical danger, fear of being given Ltine! 

work or career not being able to do the job, uneasiness about giving up one's 

work or career, and misgivings about one’s health. 
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rated low with sufficient consistency to make the cliSerence between the 
mean numbers of motives checked (5.3*-3.i) statistically significant beyond 
the I cent level. This finding may indicate an implicit assumption that 
different motives can mutually support and strengthen each other. Finally, 
they thought that the type of assignment and the situations to be en- 
countered had to be considered before the specific motivation of a candi- 
date could be adequately evaluated. 

In describing their methods of evaluating motivation, some, though not 
all, of the interviewers professed to make ample use of the general principles 
followed in assessment, in attempting to relate motivation to other sig- 
nificant aspects both of the candidate’s personality and of the situations in 
which he was to be placed. To what extent they succeeded in carrying out 
this program it is hard to judge. By definition, Motivation for Assignment 
referred not to an enduring pattern of forces but to a relatively segregated 
system in the sequence of personal strivings; and as such it formed a specific, 
well-outlined topic of discussion in the interview. If data and time for an 
integration of this topic into the rest of the personality picture were lack- 
ing, one could take the easy way out and base one’s rating and description 
of the candidate’s motivation on his own report, taken as a relatively isolated 
datum. But even a most scrupulcjus attempt at a contextual evaluation of 
the revealed motives might fail to bridge a gap that could occur between 
motivation for obtaining the assignment (which was operating at the time 
of assessment) and motivation in the pursuit of other distal goals that would 
arise after this proximal goal had been attained* 

REPORTS ON PERFORMANCE OVERSEAS. — ^As was mentioned earlier, wc were 
unable to obtain appraisal data that would permit us to make a real test 
of our criteria for evaluating motivation. The best procedure would have 
been to compare reliable reports of each candidate’s performance and de- 
gree of motivation in the theater with the conception of his motivation 
obtained during assessment. Such reports, however, are available only for 
20 out of the 503 candidates whose motives were systematically checked, 
and several of these arrived in the theater too late to be able to do the job 
proposed for them. This group of 20 men were not well distributed in any 
respect; the lowest job rating was Low Average (2); the range of the over- 
seas appraisals for Motivation was narrow, between 3 and 5. Thus it is 
impossible to obtain clcar-cut results by comparing the incidence in each 
group of the varioUvS types of motives. It may be noted, however, that while 
none of the 12 persons who were given a high overseas rating (4 or 5) 
on Motivation had an escape or prestige motive checked at assessment, one 
or the other of these motives had been checked in 5 out of the 8 men whose 
Motivation was rated Average in the field. 

In considering individual cases, we shall single out 7 persons who were 
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rated high (4 or 5) overseas both on Motivation and on Job Performance. 
The data for forming a contrasting group are insufficient; none of the 
men was low in both Motivation and Job Performance, and the reports on 
the 13 average cases are for the most part incomplete or inconsistent. 

Two of the 7 successful men present cases of strong social motivation 
based on a firm ideological foundation; both had given the necessity to 
*‘have the job done” as their main motive, and both related this necessity 
to patriotism and to the fight against antidemocratic forces. One of the two, 
in carrying out his specialized technical job, earned general recognition by 
his conscientious work, his eagerness to help others, and his general friend- 
liness and good nature. The other, a person of expansive temperament, 
great drive, and idealistic enthusiasms, distinguished himself on dangerous 
intelligence missions, maintaining high morale over long periods spent 
under unusually difficult and stressful conditions. A third man, another 
good leader, described as highly energetic, direct, responsible, and respected 
by all, had given the desire to do novel and interesting work as his main 
reason for wanting the assignment, but this was supplemented by the so- 
cially oriented motive of participation. No ideological foundation was pres- 
ent in this case, but the strong social orientation reflected in all reports on 
this man is a characteristic he shares with the first two subjects. 

The fourth man presents an exemplary case of sound and sustained 
motivation based primarily, if not solely, on a rational sense of duty de- 
veloped in a well-integrated, self-confident personality. A successful tech- 
nical administrator, this man was drafted for a specialized job. At S he had 
described his attitude as follows: *‘I knew that my background was useful 
and I did not see how I could not do it. Tm glad to be doing it. I have felt 
for some time that I ought to be doing something." There was nothing 
spectacular about the quality of this man*s motivation: because of his un- 
willingness to leave his business for an indefinite period of time, he even 
stipulated in advance the duration of his assignment. Yet this limited 
motivation proved adequate to ensure a steady and generally effective per- 
formance. Though a high-class specialist, he willingly did menial jobs when 
necessary, and his work was praised as painstaking, conscientious, and 
thorough. He was discreet, tactful, and uniformly friendly in relations with 
his associates and easily gained their confidence and respect. 

The next case requires more interpretation. It is the case of an Army 
man who during assessment gave as his main motive in volunteering for 
an operational assignment his conviction that he possessed the requisite 
skills. Neither this motive, nor the desire for adventure which he professed 
in addition, seemed to stem from a feeling of self-confidence; the candidate 
voiced, on the contrary, a number of misgivings about his health, strength, 
and ability to do the job, commenting that he would not volunteer for any 
particularly hazardous duty within his assignment, but would not refuse if 
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his superiors felt he could do it. His Emotional Stability was rated as Low 
Average in assessment. This picture suggests an insecure person whose de- 
sire for adventure may have been closely related to a desire to test and prove 
himself, or to maintain threatened selLrcspect, attitudes which do not hold 
much promise o£ success in an operational assignment, Actually, the candi- 
date never got into the field; while waiting, along with others, for his job 
to materialize, he volunteered for work as a supply officer. This job he did 
so conscientiously that he was held up as an example of responsibility per- 
sonified and won the general approbation of his colleagues, despite the 
fact that he was not particularly popular as a social creature. This case 
demonstrates how even motivation stemming largely from insecurity can 
prove highly effective in certain kinds of situations, especially in situations 
which are less challenging than those which the person has set himself 
to meet. 

The remaining two cases arc those of successful field leaders, both of them 
described as “authentic heroes/’ distinguished for bravery. While social 
motives were not missing from their lists of reasons for wanting an assign- 
ment, they were outnumbered by egocentric motives, most, but not all of 
them, of an expansive, sclf-conficlcnt variety. Although both men were well 
liked and highly valued as leaders, each presented some problems. One 
was described as emotionally immature, lacking serious purpose in life. The 
other was said to be unreliable and uneven in his work, to have no tolerance 
for routine, and to want recognition first and foremost. He was considered 
by some of his supervisors as a “problem child*’ whose ability made him 
well worth the effort required to manage him successfully. These two 
cases illustrate admirably both the positive potentialities and the limitations 
of a predominantly egocentric motivation. 

Thus out of seven cases of high motivation that resulted in effective per- 
formance, three men showed a strong social orientation, with or without 
underlying ideology; two were motivated by the sense of duty, or related 
concerns; and two by predominantly egocentric motives aiming at activity, 
adventure, and prestige. In most cases, while one motive, or one cluster of 
motives, seemed to predominate, it was combined with one or more motives 
of a different nature, Thus even the proponent of militant democracy, "who 
voiced strongly almost all of the social motives listed, was also motivated 
by the dc.sire to have wide scope for individual ability and action; and the 
two men oriented to prestige and adventure also mentioned motives like 
duty and patriotism. This is consistent with the hypothesis that might be 
tentatively formulated on the basis of our findings: reliable and effective 
motivation may be the function less of any one particular strong drive than 
of some pattern of predominantly positive motives well integrated in t^ 
personality. The few cases reported here can do no more than exemplify 
roughly some of these configurations and demonstrate that various pattern? 
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of motives can be equally effective in different situations of overseas war- 
time service. 

ENERGY AND INITIATIVE 

The Energy and Initiative aspect of Motivation was perhaps, from the 
practical point of view, our least problematic variable. Its rating required 
little interpretation and was seldom a subject of discussion or of disagree- 
ment among the raters. The reason for this was that the scoring of it was 
based primarily on the sheer quantity of the candidate’s output, the amount 
of his physical and verbal participation in the various situations, especially 
the group situations. On the one hand, it was possible for a candidate 
merely to stand by and watch the others work, or listen to them talk; on the 
ocher, he could, if he chose, work unremittingly toward the solution of the 
problem, be it by executing several physical operations in the field projects, 
or by talking frequently and at length in the discussion situations. A person 
whose participation was high received a high score on Energy and Initiative, 
particularly if he also introduced new ideas, attempted to organize and 
direct the work of others, called for speed, and in other ways showed con- 
cern and assumed responsibilities for the completion of the project. 

The individual situations did not give the subject quite the same oppor- 
tunities to display these traits, or lack of them, as did group situations. 
Being given a task to solve by himself, the subject could not very well re- 
main completely inactive; on the other hand, he had no chance to apply 
his energy and initiative to the organization of the efforts of others. For 
Period G the final score on Energy and Initiative correlates .41 with the 
subscore given on the Obstacle Course, while the coefficients of correlation 
between the final score and the subscores given in situations presenting op- 
portunities for leadership range between .51 for Debate and .77 for Assigned 
Leadership. The data from the earlier periods also bear out the conclusion 
that individual situations contributed markedly less to the final score on 
Energy and Initiative than did group situations. 

In addition to the amount of work he did, the extent to which a candidate 
put himself into situations was also considered in rating his energy: this 
was reflected In the physical effort the candidate displayed, in his willing- 
ness to take risks and discomforts, in the degree of personal involvement 
as he tried to get his convictions across to others in discussions. Situations 
that demanded an overcoming of difficulties or involved an element of 
frustration (Obstacle Course, Construction) presented a good opportunity 
for observing the candidate’s perseverance, or lack of it, in the face of ob- 
stacles and failures. 

The purely verbal situations (Discussion, Debate), and those in which 
the exchange of opinions, if at all demanded, were only a means for solving 
a physical problem, contributed about equally to the final score of Energy 
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anc initiative. In some individual cases, however, there were great differ- 
ences between the subject’s participation in these two types of situation, 
diflercnccs related to the candidate's interest and competence in different 
types of work. Some men with academic or literary backgrounds were both 
inept and inactive in field problems, but came into their own in Discus- 
sion and Debate. The reverse was true of those who possessed little infor- 
mation on current issues but had had a great deal of experience in outdoor 
life or in solving technical problems. Intercorrelations between the scores 
on Energy and Initiative given in the various situations range, for Period G, 
between -.09 and .62 with the median at .25. The two lowest correlations 
are between the Obstacle Course and Debate and the Obstacle Course and 
Discussion (-.09 and ,07, respectively), that is, between a purely ‘physical” 
and a purely “verbal” situation. The two highest are between Brook and 
Assigned Leadership and between Discussion and Debate (.62 and .49, 
respectively), that is, between situations of the same type, either “physical*’ 
or “verbal.” However, some correlations between the “verbal” and “non- 
verbal” situations arc also fairly high; thus Assigned Leadership correlates 
.48 with Debate and .41 with Discussion. The results are similar for the 
data of earlier periods. On the whole, even though competence in some 
fields of work favored certain candidates in certain situations, none of the 
situations used to obtain scores on Energy and Initiative demanded such 
specialized activity tus to preclude participation on the part of any candidate, 
With a wide range in the kinds of situations used, the chances of penaliz- 
ing any candidate for lack of competence in a special field were not very 
great. The full table of intercorrelations may be found in Table 59, page 517. 

Table ii shows the correlations between the final score on Energy and 
Initiative and the final scores on other variables. 


TABLE II 

Correlations between Energy and Initiative and Other Variables 

(Period G) 


Leadership 7^ 

Effective Intelligence, 56 

Emotional Stability 5 ^ 

Motivation for Assignment 44 

Physical Ability 4^ 


Social Relations 37 

Propaganda Skills 37 

Observing & Reporting *34 

Security •^■3 


The high correlation with Leadership is understandable when one con- 
siders that all acts involving leadership and organizing also contributed 
to the rating of Energy and Initiative. Although it was possible for a person 
who limited himself strictly to the role of follower to obtain high ratings 
' on energy by working hard in this rdle, a leader, by definition, cou ^ not 
be a passive onlooker and would have to display a fair amount of initiative 
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in order to exercise effective control, la considering the correlation with 
Effective Intelligence, it is importimt to remember that in situational tests 
the person who remained inactive forfeited the opportunity to display his 
intelligence in words or acts^ and was often penalized for it by low ratings. 
The correlation with Emotional Stability cannot be explained by such over- 
lapping of the bases of ratings, since in determining the final rating of 
Emotional Stability the interviewer’s judgment was given the main weight 
and since there was only one situation (Construction) that yielded scores 
both on Emotional Stability and on Energy and Initiative. One might ex- 
plain die correlation by assuming that the conflicting tendencies and inhibi- 
tions of people of low emotional stability prevented them from acting freely 
and vigorously in most situations; on the other hand, we have seen many 
candidates 'whose maladjustments seemed to have resulted in a driving 
ambition which led to energetic and persistent action. A sizable correlation 
between Motivation for Assignment and Energy and Initiative was to be 
expected, since it was necessary to show energy in doing the tests in order 
to attain the goal, the desired assignment. The fact that the correlation is 
not extremely high, however, perhaps indicates that factors other than 
the strength of a momentary, circumscribed goal determine a person’s 
customary output of energy; these might be a fusion of enduring drives, 
such as a desire for achievement and recognition, or pleasure in activity and 
an interest in tasks as such, or a physiological factor determining general 
level of activity. Although many candidates put forth a deliberate and de- 
termined effort because they wanted their assignments, great energy was 
not always an indication of such desire. A case in point is that of a candi- 
date who, upon obtaining further information about his proposed assign- 
ment, decided not to accept it. Yet he worked extremely hard on all tasks. 
He himself laughingly observed that he was almost killing himself trying 
to pass the test for a job he did not want. 

EFFECTIVE INTELLIGENCE 

Some psychologists have defined intelligence, implicitly or explicitly, as 
the speed and accuracy of the mental processes involved in responding to a 
specified, standard, paper-and-pcncil test: the I.Q. is the measure of intel- 
ligence. Although this definition has the advantage of being operationally 
precise and unequivocal, we must be counted among those who are not in 
favor of adopting it, because, in the first place, if '‘intelligence” is assigned 
this very limited meaning, then another term will have to be selected or 
invented to denote the e'ffecttveness of the whole system of mental oper- 
ationsy and for this it is not likely that any term more suitable than “intel- 
ligence” can be found and given currency. In the second place, there are 
other kinds of mental ability, not measured by the conventional paper-and- 
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pencil tests, which seem to be as much involved in so-called “intelligent” 
operations as arc the measured abilities, and are, therefore, equally entitled 
to be accepted as indications of intelligence. 

Although the problem is a terminological one, it cannot rightfully be 
brushed aside as a “mere” matter of words, because, whether we like it or 
not, “intelligence” is a highly valued symbol, and its application to one kind 
of mental ability rather than to another is likely to be determined by a 
sentiment rather than by factual or logical considerations; and in the second 
place, the association of “intelligence” with a particular kind of mental 
ability will solidify the favoring sentiment and the social consequences of 
this development may be considerable. 

Conception of Effective Intelligence. — There is some advantage, we 
believe, in correlating the term “intelligence” with the effectiveness of any 
system of mental functions and In designating the nature or purpose of 
each distinguishable system by an appropriate adjective, such as aesthetic 
intelligence, social intelligence, scientific intelligence, administrative intel- 
ligence, mechanical intelligence, and so forth; and then designating by a 
suitable term each separable function (mental ability) that is involved in the 
operation of each system, such as, observational ability, evaluative ability, 
interpretive ability, memory ability, conceptual ability, imaginative ability, 
logical ability, predictive ability, planning ability, manipulative ability, and 
so forth. 

Suffice it to say that in the assessment of OSS personnel, our interest was 
focused on the mental abilities which would be called into play in perform- 
ing the various roles to which accepted candidates would be assigned. Since 
there were fifty or more different roles, many kinds of mental ability had 
to be considered, many more, certainly, than the number involved in 
responding to a paper-and-pencll test. Thus we were forced to reach for a 
notion of intelligence which, though not exhaustive, was much more 
comprehensive than the I.Q. conception, and having once adopted it, we 
had to abandon the policy of relying wholly on a standard intelligence 
test as a measure of all that was embraced by it. 

Intelligence tests have been remarkably efficient in discriminating persons 
in the lower ranges of mental capacity (thcTccble-minded, imbeciles, and so 
on) and in predicting, with considerable validity, the scholastic achievement 
of those with normal minds. As we know, the tests have been developed 
largely In connection with the concerns and aims of educational institutions 
(including military schools of all sorts) and, generally speaking, the chief 
criterion in deciding which of several mental tasks should be included in 
an intelligence test has been the degree of correlation, with school grades 
mostly based on written examinations and other types of paper work. This 
is proper in so far as the prime purpose of the test has been to predict schol- 
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astic achievement, but it does not encourage us to suppose that this test 
would be efficient in predicting other forms of attainment. We have no good 
reason to suppose that scholastic intelligence is highly correlated with aes- 
thetic, social, administrative, military, financial, or mechanical intelligence, 
or that memorizing ability (an important factor in obtaining good grades 
at school) is highly correlated with creative ability (imagination, resource 
fulness, ingenuity, and the like). 

In view of these considerations, the members of the OSS assessment staff 
agreed, first, that paper-and-pencil tests should constitute only a part of the 
battery of procedures selected to measure intelligence; and second, that, in 
order to avoid confusion between the I.Q. and the conception of intelligence 
which we had adopted, our variable would be called Practical Intelligence 
(later, Effective Intelligence). 

As we shall explain in due course, this matter was not clearly envisaged 
at the very start of our undertaking. Effective Intelligence was not operation- 
ally defined in much detail, and even after a year or more of work, misun- 
derstandings would arise as a result of loose terminology. Occasionally, for 
example, the writer of a personality sketch would make a statement that 
was based solely on the scores obtained on two or three paper-and-pcncll 
tests. He would write, “The intelligence of this candidate is inferior ac- 
cording to S standards.’' In such a case, the branch chief might call for 
an explanation. “What do you mean by calling X inferior?” he would say. 
“I have known him for several years and have watched him at work in 
the office here for five months, and I consider him one of the most intel- 
ligent men in this branch.” 

Since this book is no place for the discussion of fundamental issues, we 
shall limit ourselves here to a brief account of the conception of Effective 
Intelligence that was accepted more or less by the OSS assessment staff, 
and shall make no attempt to demonstrate that this conception closely ap- 
proximates the most suitable general definition of intelligence. 

In defining intelligence there are two basic questions to be answered: 
(i) To what psychological processes (functions, abilities) can the adjective 
“intelligent” be fittingly applied? Or, in other words, to what functions 
should one attend in judging intelligence? (2) What are the most suitable 
measures of intelligence? That is, in terms of what criteria can a scale of 
intelligence be defined? As a preliminary step in answering the lirsSt ques- 
tion, we would say that any ability which can properly he called mental 
or intellectual deserves to be included within the sphere of our conception. 
Hence the first question might be stated in this way: What are the chief 
kinds of mental processes (functions, abilities) ? As a preliminary step in 
answering the second question, it is necessary, we suggest, to distinguish 
between (i) efficiency of Intelligence (e.g., the speed, economy, precision, 
effectiveness, with which any mental task is carried out) and (ii) level of 
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iiicelligence (the degree oL difficuky of the accomplished task). At this 
point it might be well to remind ourselves that each type of mental process 
can be applied to many dllTcrcnt kinds of objects (human, inanimate), and 
can serve any one of a number of different aims (economic, political, social, 
aesthetic, or scientific). Since everybody varies in respect to the effectiveness 
with which his several processes can deal with the different kinds of objects 
and in respect to the effectiveness with which these processes can serve 
the different aims, it is necessary to distinguish various classes of objects 
and various classes of aims. 

Mental Abilities. — For the purpose of assessing abilities required by OSS 
intelligence and operating personnel, it may be convenient to classify them 
in the following four phases: 

A. Afferent 

1. Collection of data: perception, selection of significant facts, The whole 
range of receptive and recording enterprises from a quick glance to a long 
and elaborate exploration; watching, listening, and reading; research and 
experimentation, analysis of findings, judgments of reliability. Also regis- 
tration of observations: memory, note taking, photography, and so forth. 

2. Diagnosis of the situation: apperception, interpretation, inference, 
structuration of the behavioral field, explanation of phenomena in terms of 
scientific theories, formulations and assessments of personality. Also evalu- 
ations of power and merit. The whole range of cognitive processes from a 
quick insight to a long series of logical inductions; prediction of the unin- 
fluenced course of events, anticipation of possible contingencies. 

B. E-ff event 

3. Conception of plan: selection of the most strategic goal(s) and im- 
provisation of means thereto; scheduling of projects and subprojects, selec- 
tion of agencies, designing of instruments. Prediction of the results of action 
(the outcome of interventions), plans to meet possible contingencies, 
setting the level of aspiration. Also, communicating plans to others. 

4. Execution of action: verbal and muscular behavior. The whole range 
of overt action from a quick response to a life-long undertaking; dealing 
with things, animals, and people. Managing and administering (leadership) 
activities, performance of special functions; striving with perseverance until 
goal is attained. 

It is scarcely necessary to point out that there are inseparable gradations 
and overlaps between each of these phases. The collection of data, for 
example, is seldom a mechanical accumulation of personal impressions and 
reported occurrences, but rather a careful selection of facts in terms of several 
alternative diagnoses of the situation. That is to say, ideas commonly precede 
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and determine perceptions; a man will look for signs which prove or dis- 
prove an hypothesis. Also observation and interpretation are very apt to 
occur together, forming a single indivisible process that results in the im- 
mediate retention or rejection of the presented data, depending on whether 
they are pertinent or not pertinent to a given notion. Discrimination of 
relevance is thus a function which calls for the interplay of perception 
(i, collection of data) and formulation (2, diagnosis of the situation). Con- 
sequently, in explaining the inadequacy of a man’s observations, it may 
be hard to say whether he is a good observer with an inadequate conceptual 
scheme (he does not understand enough) or whether his concepts are suffi- 
cient but his powers of observation defective. 

The above scheme is a convenient one for classifying roles as well as 
mental abilities. The roles (functions) undertaken by the OSS, for example, 
can be roughly divided into: 

A. Afferent: the collection, analysis, interpretation, and reporting of in- 
formation about significant proceedings in enemy territory. 

B. Efferent: the planning, teaching, and execution of physical (sabotage) 
and verbal (propaganda) operations against the enemy. 

This mode of classifying roles may be confusing to some readers, since 
every role necessarily involves all four phases of a total mental arc (observa- 
tion, diagnosis, planning, action) : a secret intelligence agent (afferent role) 
must decide on a plan of action (exploration, interrogation, and the like) 
and execute it; and a saboteur (efferent role) must observe and size up the 
confronting situation before he can act effectively. The two assignments are 
different, however, in respect to their final goals: no matter how active, 
physically and verbally, the secret agent may have to be to gain his end, the 
success of his efforts is measured in terms of the quality and quantity of 
the information which he obtains; and although verbal action is involved 
in the communication of his findings, this final efferent phase can be con- 
sidered secondary to his superordinate afferent role. The success of the 
saboteur, on the other hand, is measured in terms of the quality and quan- 
tity of the damage that is done to enemy installations as a direct result of 
his efforts. Thus the two roles are complementary: the investigator dis- 
covers the location of the strategic targets and the operator strikes them, 
Presumably the former would be especially fitted, by native talents or 
training or both, to observe and to interrogate; to remember what he has 
seen, heard, and read; to analyze, evaluate, and interpret the material ob- 
tained, to report his findings and conclusions accurately and succinctly. And 
the latter, the operator, if functioning on a physical level, should be above 
average, not only in athletic ability and daring, but in short-range planning 
ability, resourcefulness, fitness for emergencies, mechanical ability, leader- 
ship ability (many of the operators were expected to lead native resistance 
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groups, if not Americans), teaching ability (the instruction of resistance 
groups in the use of new weapons and explosives was usually included 
among the functions of a field operator), and sometimes, recruiting ability. 
When he is functioning on the symbolic level, the operator (propagandist) 
should presumably be above average in his ability to select strategic goals 
(“target groups” with points of special psychological vulnerability), to 
devise novel and ingenious techniques of reaching the target groups, and to 
influence the target groups by the use of some art (e.g., radio broadcasts, 
pamphlets, posters). 

To list in this way the chief functions of those fulfilling afferent and of 
those fulfilling efferent roles draws attention to the differences between 
these roles. Actually, when working behind enemy lines the collector of 
Intelligence and the saboteur used very similar mental abilities: both were 
in danger; both had to observe and size up new situations quickly and be 
resourceful in devising ways of meeting them; both had to deal with things, 
calling for mechanical Intelligence, and with people, calling for social in- 
telligence, et cetera. Thus the similarities of functions were often more obvi- 
ous than the dissimilarities. 

Instead of dividing the mental phases Into afferent and efferent, we may 
divide them into peripheral (i, collection of data, and 4, execution of 
action) and central (2, diagnosis of situation, and 3, conception of plan). 
This line of cleavage stresses the differences between those who were out 
in the field restricted to a small region of operations, and the upper-echelon 
administrators and executives at Washington and at the base in each theater 
of operations, who received all reports from the field and put them together 
to make a total picture, and on the basis of this diagnosis decided on long- 
range goals and subsidiary projects. Presumably those with central, rather 
than peripheral, functions would have to, possess much more than average 
ability to grasp complicated situations in their totality (e.g., military, political, 
economic, social), and to select the most strategic targets and objectives, to 
develop plans for achieving these major aims, to foresee difficulties and de- 
vise ways of surmounting them, to select suitable subprdinates, to administer 
efficiently a large organization or branch of activities, to excite loyalty and 
cooperation, and so forth. 

Without going Into further details, we submit that this scheme provides 
a simple means of ordering for our purposes all functions which deserve to 
be Included within the sphere to which the term '^intelligence^* can properly 
be applied. In other words, the scheme includes all mental abilities, and, in 
addition, a few nonmental abilities. We submit that phase 1, collection of 
data, Involves some processes at the sensory boundary of personality, and 
phase 4, execution of action, involves some processes at the motor boundary, 
which are so largely peripheral in nature that they had better not be classi- 
fied among mental processes or abilities. These nonintellectual functions are 
of two kinds: 
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1) Sensory Ability: chiefly, visual and auditory acuity and discrimination. 

2) Physical Ability: chiefly, muscular strength, agility, and endurance. 

In the OSS, each candidate’s sight and hearing and state of health were 

tested by the Medical Branch, but his athletic skill was tested at Station S 
and rated as a separate variable. Physical Ability. Aside from these two, sen- 
sory ability and muscular ability, everything that is embraced in the above- 
mentioned scheme should be taken into account in any comprehensive at- 
tempt to estimate intelligence. 

In the beginning, during the period when the assessment staff’s conceptual 
scheme for personality consisted of a rather large number of components, 
about thirteen separate variables were used to cover the sphere of intel- 
ligence. Classified according to the four functional phases, they are: 

A, Afferent. 1. Collection of data 

i. Observation 

ii. Memory 

2, Diagtwsis of the situation 
ill. Inference (interpretive ability) 
iv. Judgment of People 

V. Test Intelligence (discrimination of verbal and nonverbal 
forms) 

B. Efferent. 3. Conception of plan 

vi. Planning Ability 

vii. Resourcefulness (ingenuity and originality in solving means- 
end problems— physical and social) 

viii. Mechanical Comprehension (paper-and-pcncil test of the abil- 
ity to conceive the solution of mechanical difficulties) 

ix. Teaching Ability (ability to explain tcclinicjucs of action) 

4. Execution of action 

X. Fitness for Emergencies (ability to react effectively to sudden, 
unexpected stimuli) 

xi. Leadership (skill in managing people) 

xii. Persuasiveness (ability to affect others with words) 

xiii. Recruiting Ability (involving both judgment of people and 
persuasiveness) 

It may be difficult for the reader to understand why some of these vari- 
ables are classified as they arc. Why, for example, is Teaching Ability .sub- 
sumed under 3, Conception of plan? It is placed on the efferent .side of the 
arc because, although it included the exposition of facts and interpretations 
(afferent phase), teaching in the OSS was oriented toward action. Although, 
on one level, the process of instruction is itself an action, on another it is 
rather a matter of communicating technical plans of action to those who will 
put them into effect. 

_ In attempting to classify abilities one soon runs into the problem of the 
inseparable gradations between categories and the problem of overlap, the 
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mutual involvement o£ categories, which complicate the task of defining 
these operationally and devising tests for each. How, for example, shall we 
define and test mechanical “know-how”? The actual solution of a mechan- 
ical or engineering difficulty involves all four phases— observation, estima- 
tion of the situation, conception of an efficient plan, and execution of the 
plan. Under ordinary circumstances only the last phase (the behavioral) 
is observable. If this succeeds, one knows that the three preceding phases 
have been successful; but if it fails, there is no telling, without special in- 
vestigation, which of the four phases was defective. Did the man fail to 
perceive the rope on the ground and the wrench near by or did he fail to 
realize the means-end possibilities of these two agencies? Did he fail to esti- 
mate correctly the speed of the river’s current or was he too weak or clumsy 
to stand up against it? Was he misguided in calculating that a rope could 
be thrown over that branch on the other side of the river or was it just 
awkwardness on his part which caused his attempts to fail? Such questions 
are often hard to answer. What we were likely to do if we wished to meas- 
ure mechanical “know-how” was to present the candidate with a fairly 
clear-cut situation so that observation and diagnosis were relatively simple 
(within the capacity of everyone) and in this way to eliminate the afferent 
side of the arc as a distinguishing determinant. Athletic ability and manual 
dexterity can be eliminated in one or both of two ways: ask the candidate 
for a plan of action (before directing him to proceed) or make allowances 
for lack of muscular dexterity or strength based on the results of special 
tests of these powers. 

We do not want to spend any more time on the above list of variables, 
however, because after four months of experimentation it had hot assumed 
a practically useful form. The first three on the above list, together with 
several new ones (ability to interrogate, ability to analyze and evaluate data, 
ability to write concise reports), were absorbed into one variable, termed 
Observing and Reporting, This embraced almost all of the intellectual abil- 
ities on the afferent side of the arc. Leadership retained the status of a 
separate variable. Recruiting Ability and Teaching Ability were dropped 
from the regular list because they were applicable only to a minority of the 
candidates. All the other abilities were absorbed into a new variable, Ef- 
fective Intelligence. 

Effective Intelligence embraced all the functions on the efferent side of 
the arc. It was taken to denote chiefly the ability to select (within the frame 
of a designated over-all objective) the most strategic realizable goals and to 
conceive (select, discover, or invent) the most efficient means for arriving at 
these goals. Thus we were principally concerned here with functions which 
fell into the third reaction phase (3, Conception of plan), but which would 
not ordinarily be exhibited except by way of the fourth phase (4, Execution 
of action). These two phases are not always highly correlated, A man may 
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think of the best way o£ doing something, but yet be incapable of accom- 
plishing it himself. An extreme case would be that of a sick old man who 
worked out the best possible way of climbing Mt, Jivercst. With us, how- 
ever, it was not usually feasible or even desirable to attempt a sharp dis- 
tinction between effective planning and effective performing. The best we 
could do on the bodily level of activity was to separate out Physical Ability, 
and more or less assume that the chief remaining determinant of success 
or failure would be the ability to devise effective means-end solutions of 
physical problems, (Here wc are temporarily disregarding variables be- 
longing to other areas of personality— energy, motivation, emotional stabil- 
ity, and so forth.) On the verbal level of activity, however, no distinction 
was made between effective planning (e.g., selection of a strategic objective, 
logical organization of ideas, comprehensiveness of exposition, congruence 
of concepts and images with facts), and effective performance (e.g., verbal 
facility, manner of delivery), 

Thus our conception of Effective Intelligence shifted the focus from intel- 
lection as an afferent function— the conceptualization of one’s environment 
—to intellection as an efferent function— the formulation of plans (e,g., 
strategic projects, practical techniques). For one period the final rating on 
Observation and Reporting was taken into account in assigning ratings on 
Effective Intelligence. Although, by so doing, Effective Intelligence was 
stretched to contain all four phases of intellectual activity, the practice was 
discontinued. 

Objects of Intelligence.— -No mental ability is equally effective in dealing 
with all kinds of materials. Various innate and acquired factors combine 
to determine that one man is unusually proficient in music, another in 
repairing machinery, a third in manipulating numbers and symbols. There 
seem to be a great many special abilities. Since the OSS staff was not asked 
to test for any such very specific talents, the matter of their classification 
need not detain us. For our purposes a very crude classification was 
sufficient: 

1) Ability to deal with things (e.g., physical obstacles, machinery, weap- 
ons, radios, gadgets)— mechanical intelligence. 

2) Ability to deal with people — social intelligence. 

3) Ability to deal with ideas (e.g., concepts, numbers, symbols, abstract 
formulations, ideologies)— conceptual intelligence. 

These have already been casually mentioned in connection with the vari 
ous mental functions. Mechanical intelligence was tested by one paper- 
and-pencil test and in several outdoor situations where the candidate was 
required to find quick solutions for minor “engineering” problems or prac- 
tical emergencies. One phase of social intelligence was measured by the 
Judgment of Others Test, another phase by the Discussion and the Debate. 
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This type of ability, however, was more adequately covered by two separate 
variables, Scjcial Rchiuojis and Leadership, and, to some extent, by Propa- 
ganda Skills, Verbal and abstract intelligence were measured by the Vocabu- 
lary Test, the Matrix, and later, the Otis, as well as by several group situa- 
tions (Discussion, Debate, and SIX-2). 

Measurement o£ Efiective Intelligence. — The tests and procedures from* 
which ratings on Intelligence were obtained were not, in actual practice, 
classified according to the categories given above, but, for greater con- 
venience, according to certain technical criteria. 

The part of the total battery which was classified “test intelligence” in- 
cluded the Vocabulary Test, the Mechanical Comprehension Test, and at 
first the Matrix and other nonverbal tests and later the Otis. It was hoped 
that this combination would yield a measure of the kind of intelligence that 
is conventionally represented by the LQ. The excellent Wechslcr-Bellevue, 
an individual test, was administered when there was reason to believe that a 
low score on the group paper-and-pcncil tests was not a valid index of the 
candidate’s intellectual powers. Among the most frequent reasons for this 
belief were the interference of age (in candidates over fifty) with perform- 
ance in such speed tests as the Otis and a language handicap impeding prog- 
ress on the vocabulary tests. Another reason was the occurrence of marked 
discrepancies between the scores obtained on the different tests of the battery, 
The Wechsler-Bcllevue was also useful in cases where some neurotic or 
psychotic tendency was suspected. 

The chief tests of so-called “verbal intelligence” — judgment, speed, re- 
sourcefulness, originality in handling words — were the SIX-2 Test, the Dis- 
cussion, and the Debate. The first was a written test, the other two were oral. 

The part of the battery which was classified as “practical intelligence” 
was designed to measure each candidate’s effectiveness in dealing with 
simple mechanical or physical tasks in an outdoor setting. The procedures 
included the Brook and the Assigned Leadership. The latter yielded ratings 
of intelligence when the candidate acted as a leader and intelligence when 
he acted as a subordinate. 

Finally, there was the Interview, which, as it happened, yielded the most 
crucial single rating. This represented the interviewer’s over-all impression 
of intelligence based on the candidate’s work history, on his past accom 
plishments, on his present alms and expectations, and on the knowledge and 
skill manifested by the candidate in analyzing his past experiences, the 
situations he had encountered, and his motives in joining the OSS. Not 
only did the interviewer’s rating correlate .80 with the final rating of Effec- 
tive Intelligence, but it rarely varied more than one point from the final 
rating. The explanation of this finding will be given later. 

The scoring of “test intelligence” was done objectively and mechanically 
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and, consequently, presented no problems. It was the lifelike situational tests, 
especially the leaderlcss group tests, which gave rise to almost all of our 
difficulties in rating. To estimate the value of a candidate's contribution to 
the group’s total achievement was hard enough, but to decide how much of 
his contribution was due to sheer intelligence as distinguished from other 
variables— energy and initiative, knowledge, long-standing interest in the 
given task or topic, social ability, leadership experience, emotional stability, 
and so forth— was in many instances extremely diflicult, if not impossible. 

One rule which must be observed in estimating any ability— and this 
applies, of course, to the measurement of “test intelligence"— is that the con- 
ditions should be such that the motivation aroused is as high as is necessary 
to produce the best results. Also, anxiety and other agitating emotions 
should be absent or governable. If, in one of our group situational tests, for 
instance, the candidate’s motivation was low (he was not interested in the 
problem) or his emotional stability was low (he was ttx) embarrassed to 
perform in public), he would let the others do most of the talking and the 
doing, and thus leave the assessors in doubt as to whether he was stupid 
or clever. We always made a point of taking into account such possibilities, 
but, even under the most favorable circumstances, the scores of Intelligence 
which were given on situational tests probably represented mental effective- 
ness under conditions of social stress rather than mental effectiveness in 
isolation. Consequently, those who required quiet and privacy to do their 
best thinking were probably underrated, and those whose mental processes 
were encouraged by the presence of an audience were probably overrated. 

A difficulty of another sort was that of weighting properly evidences of 
different kinds of mental ability— observational ability, memory ability, and 
so forth. Faced by the Brook problem, for example, one member of the 
group would be the first to notice the worn stub of a branch on a tree 
across the water (suggesting the possibility of throwing over it the noose 
of a rope), another candidate would propose a practical over-all plan for the 
division of functions, another would think of a way of tying the rope around 
the rock, another, without saying a word, would take the hint and show sense 
and skill in getting his knot firmly placed against a jutting ridge on the 
rock, and so forth. Should a significant observation be rated as high as an 
outline of strategy? Should a verbal “know-how" be rated higher than an 
unarticulated “can-do”? And then, how much should be subtracted from a 
man s score because of his having made this or that Impractical or stupid 
suggestion? Finally, since we are speaking here of group tests, how much 
attention should be given to social intelligence? It was not easy, for instance, 
to decide how to rate the intelligence of a man with an excellent plan who 
stubbornly persisted in an obviously futile effort to persuade the others of 
its superior merit and thereby impeded the swift execution of an already 
adopted, though less efficient plan. It was not possible to embrace all such 
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heterogeneous forms of behavior in one operationally defined rating scale, 
but something of the sort was established in the mind of each assessor as 
the result of repeated observations of different groups dealing with the 
same situation and repeated discussions about how to interpret and rate 
different kinds of verbal and physical behavior, 

The fact that agreement was satisfactory, despite the many difficulties, is 
indicated by Table 12, which gives the correlation ratio for these raters on 
two samples, each of which comprised approximately 70 candidates and 200 
ratings. 

TABLE 12 


Correlations among Raters*^ 


Situation 

n 

(Corrtlation ratio') 

Sample 

Sample 1* 

Brook 

•71 

1 

Discussion 

.86 

.80 

Debate 

.8z 

00 


" Each sample is composed of more than 70 men, each wldi 2 or 3 ratings at each situation. 


The figures demonstrate that the assessors whose ratings were included in 
these computations resolved most of their rating problems in the same 
manner. This finding, of course, is no proof that they resolved them correctly, 
Although we spent a good deal of time trying to estimate Effective In- 
telligence as a separate attribute, we all knew that our primary aim was 
to measure the effectiveness of the whole person, and that the determination 

TABLE 13 

Some Correlations between Ratings on Leadership and Ratings on 
Effective Intelligence 
{Periods V-G\ N=22o to 400) 


Final grades 63 

Brook 78 

Discussion • • 79 

Assigned Leadership (as leader) 79 


of which variables were chiefly responsible for each man’s successes and 
which for his failures was a matter of less importance, Furthermore, it was 
actually impossible to disentangle the different variables, not only because 
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the processes they represented were mutually dependent components of 
more or less unified functional operations, but because the variables over- 
lapped by definition. Leadership, for example, certainly requires effective 
intelligence, sometimes of a high order, intelligence in dealing with the 
problems which confront the group that is being led, and intelligence in 
dealing with the group itself. This relationship is shown by the correlations 
in Table 13. Each r repre.sents the degree of correlation hcivveen the two vari- 
ables when rated in the same .specified situation. 

Some of the problems we have been discussing are illustrated by the next 
table of correlations (Table 14). 

TABLE 14 

Some Correhitions between Energy and Initiative and Certain Mca.surcs of 
Effective Intelligence 

iPertod G; cxccfft aj indicated) 


Energy and Initiative, Final versus Vocabulary Test og 

Energy and Initiative, Final versus Mechanical Comprehension' Test ! ‘.10 

Energy and Initiative, Final versus Otis Test (N= 12.4) 

Energy and Initiative, Final versus Effective Intelligence, Final Grade isi 
Energy and Initiative, Brook versus Effective Intelligence, Brook. .... .68 

Energy and Initiative, Discussion versus Effective Intelligence, Discus- 


An examination of these figures reveals that the variable Energy and Initia- 
tive is not correlated to any appreciable extent with Effective Intelligence 
as measured by paper-and-pencil tests, but it is highly correlated with 
Effective Intelligence as estimated in two of the situational tests. The chief 
reason for this is that the ratings on Energy and Initiative were based, for 
the most part, on observations of the degree of zest, activity, and enterprise 
^^11 ' L t^^ndiclates during the various situations, some of which 
called for physical, some for verbal, actions. If, as explained above, a candi- 
ate was relatively inactive in a given situation, whatever intelligence he 
pos.sesse was not exhibited and, therefore, hi.s mental ability was likely to 
be undmated. Assesiiors did not ordinarily infer that .silence is wi.sdom. 
Contrariwise, if a man manifested a great deal of intelligence in a situation, 
an observer was apt to give him a high mark on Energy and Initiative on 
e groitn t lat the effectiveness of his thinking was a sure sign of mental 
energy,^ all that was required by the situation. As a rule, it was only when 
an individual did or said a good many utterly foolish or stupid things 
at t e ratings on Intelligence and Energy were at opposite ends of the 
scale. Perhaps a cultural factor was operating here, inasmuch as North 
Americans are more inclined than people of other nationalities to correlate 
activity, physical or verbal, with intelligence. The very high correlation (.88) 
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between Energy and Intelligence in the Discussion situation, for example, is 
certainly indicative of an inability on the part of most raters to differentiate 
sharply between quantity and quality of verbal expression. 

The fact that the assessors were estimaiiiig the effectiveness of a candi- 
date’s whole performance rather than distinguishing the contribution of 
each separable ability is demonstrated in an even more striking fashion by 
the following correlations: 


Physical Ability, Final versus Effective Intelligence, Final 03 

Physical Ability, Brook versus Effective Intelligence, Brook .47 


Here again is evidence that the correlation among variables was much 
higher when they were scored in a single situation. At first glance, it would 
seem that at the Brook our ratings for Physical Ability or for Intelligence or 
for both must have been inaccurate. If the most valid figure is the final 
rating, then .47 appears spuriously high. Probably it is too high, and this 
because of the impossibility, in most instances, of distinguishing in a field 
situation between “know-how” and “can-do.” Only when a candidate made 
some excellent suggestions but was awkward and inept in his attempts to 
cooperate in executing them did the ratings on Effective Intelligence and 
Physical Ability stand on opposite sides of the mid-line. At the Brook, how- 
ever, we were testing intelligence in dealing with natural obstacles and, 
consequently, some correlation with physical ability was to be expected, 
since most people acquire this as well as other forms of special intelligence 
by acting, and if they are incapable of acting they are incapable of learning. 
Exceptions to this generalization are rare but striking. There is Machiavelli, 
no field marshal, who wrote an excellent treatise on the art of war, and, 
as another illustration which some Americans may recall, there is that most 
successful coach of college swimming teams who could not swim himself. 

The source of one difficulty in rating intelligence at S was the concentra- 
tion of OSS candidates in the higher brackets of the normal distribution 

TABLE 15 

Army Percentiles and S Percentiles Equated with S Grades 

S Scale 

01134s 


Estimated Army Percentile 

1-40 

41-72- 

73-89 

90-95 

96-98 

99-100 

Arbitrary S Percentile 

7 

8^5 

2.6-50 

52-75 

76-93 

94-100 


curve (see Table 49, page 505). Since several Army tests were used at S for 
short periods, it was possible to make an approximate conversion table to 
equate Army percentiles to S grades when the latter were distributed accord- 
ing to our arbitrarily selected scheme. (See Table 15.) 

The table shows that if the staff members had adhered to the scheme of 
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distribution which was adopted as a rough guide for rating, 7 per cent 
of the S population would have been given a score of 5 on intelligence, in 
contrast to i per cent of the total Army population, and 7 per cent would 
have been given a score of 0, in contrast to the 40 per cent who would have 
been so rated in the Army. The concentration of about 50 per cent of our 
candidates above the 90th percentile, as measured by Army tests, made it 
more difficult to discriminate differences in intellectual power among these 
more intelligent men. Actually only i.i per cent of the S population were 
given the score of 5 (during Periods F and G) and only 2.3 per cent were 
given the score of 0. Over 70 per cent, instead of 50 per cent, were clustered 
in the average range (ratings of 2 and 3) . 

The norms on the paper-and-pencil tests were made to correspond to the 
S population when distributed according to our arbitrary scheme. 


0 

Very 

Inferior 

I 

Inferior 

1 

Low 

Average 

3 

High 

Average 

4 

Superior 

N 

5 

Very 

Superior 

7% 

H 

00 

2-5% 

^5% 

CO 

M 

7% 


Since the norms were established by the past population, they lagged behind 
it. They changed with the population but always affer it, and sometimes too 
long after it. If, for example, we received for assessment fifty candidates, 
most of whom were slated to be writers of propaganda, their scores on 
Mechanical Comprehension would most likely be in the 0 to 2 range. These 
scores, being tabulated, would bring down the norms a notch or two, but 
the writers themselves had, of course, been scored on the higher norms and 
so their distribution of scores would be skewed. The next group might be 
comprised chiefly of aviation mechanics, and their scores, aided now by the 
lowered norms, would be largely in the 4 to 5 range, and as a result there 
would be more skewness. We cannot say to what extent our population 
fluctuated in such cycles, but the fact remains that the norms inevitably 
lagged behind the population for which they were intended. Especially 
when a new test was used, it is difficult to see how it could have been 
otherwise with internal norms for populations that shifted. 

The most striking thing about the intcrcorrelations among the various 
individual measures of Effective Intelligence (Table 60, page 518) is 
the outstanding agreement between the interviewer’s rating and the final 
grade on Effective Intelligence. This, however, does not dispose us to believe 
that the average interview can yield a judgment of Effective Intelligence 
which will correlate .80 with a true measure of it. Surely there was nothing 
unusual about our interviews nor anything remarkable about the insight of 
those who conducted them. Something in addition to insights gained in 
that hour and a half must have been operating to produce so high a cor- 
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relation. This “something” was due to the fact that the interviewer did not 
record his rating of the interviewee’s Effective Intelligence until the last 
day. In the meantime he had observed the man in some of the situational 
tests and had rated his performance in association with other members 
of his staff team. Under these conditions it was inevitable that his rating of 
Effective Intelligence would be close to the rating which would be finally 
agreed to in the staff conference. And, furthermore, almost invariably it 
was the interviewer’s opinion about a candidate that carried greatest weight 
in the final conference. 

Assuming that the final rating is the best measure of each individuars 
Effective Intelligence, one might conclude, after glancing at our correlations, 
that the Discussion (or the Debate) is a better index of intelligence than 
the Wechslet'Bellevue or the Otis, It seems certain, however, that the Debate 
as given at S, taken alone, is a relatively poor measure of Effective Intelli- 
gence, but since it came late in the program, the ratings given then were 
influenced by much that the candidate had done through the days preceding 
this situation. Moreover, not everyone was given a rating on Intelligence at 
the Debate. Frequently only a few, those about whose grades there waj less 
question, were rated. Thus it would be a mistake to infer on the basis of 
the correlation (.73) that the Debate was a good test of Effective Intelligence, 
Some of the other tests are open to similar reservations. 

Inspection of Table 60, page 5i8> conforms to the assumption that a few 
more or less discrete categories of intelligence can be distinguished. Our 
data may be ordered in this fashion: 

1) Physical-Social (Outdoor-Practical) Ability, as measured by the Brook 
and the two Assigned Leadership tests. Here the tactical skill required was 
largely mechanical in nature, but it also included the ability to give concise 
directions. The median intercorrelation of these three tests was .41, None 
of them correlated as highly as this with any test outside this cluster. 

2) Verbal-Social (Speaking) Ability, as measured by Discussion, Debate, 
Judgment of Others, and Vocabulary. Here the chief requirement was the 
mobilization of adequate ideas and words. The ability to size up other 
people was also a factor. The median intercorrelation of these four tests 
was .52. 

3) Verbal-Abstract (Writing) Ability, as measured by the Otis, Vocabu- 
lary, and SIX-2, These are all written tests. What is required is the ability 
to deal with words, and to some extent, with ideas. The median intercor- 
relation of the three tests is ,43. There is some overlap between this and the 
preceding cluster since the Vocabulary Test enters into both. Also, the 
median of the correlations with these tests of Judgment of Others, based 
on written sketches, is .47. 

4) Nonverbal Abstract Ability, as measured by Mechanical Comprehen- 
sion, Nonverbal, and Otis. This cluster is not very homogeneous, due to 
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the presence of the Otis, which is correlated more highly with the members 
of the preceding cluster. The Otis is a test of the catch-all sort which is 
likely to appear in several clusters. The correlations of Mechanical Compre- 
hension with the Nonverbal Battery is .37 and with the Otis 

Determination of the Final Rating.— In view of the fact that in 24 per 
cent of the cases the final rating was not the same as the simple average 
of all the ratings but was one grade below or above the average, wc might 
examine the data to discover, if possible, some of the factors which deter- 
mined the shift. One determinant, we would suppose, was the greater 
validity, in our minds, of some tests as compared to others. By calculating 
for each test the percentage of ratings which agreed with the final rating, 
we obtained one measure, not free from ambiguity, of this determinant. The 
figures show that the interviewer's rating (64 per cent agreement) was the 
most influential. Next in order were the verbal-social tests, Discussion and 
Debate (average 34 per cent), followed by the practical outdoor tests (average 
51 per cent), the paper-and-pencil tests (average ^7 per cent), and Judgment 
of Others (36 per cent) . 

Among the other more important factors leading to a final grade that 
was different from the simple average was the anticipated recommendation. 
When the staff’s decision for a candidate was to be Highly Recommended, 
the final rating, if changed at all, was likely to be raised; whereas if the 
decision was to be Not Recommended, the final rating, if changed, was 
likely to be lowered. 

The influence of the interviewer calls for special consideration. Our 
figures show that when, during the first months of the program, the final 
grade deviated from the average, the interviewer’s grade, in the majority 
of cases, also deviated from the average and nearly always in the same 
direction. We conclude from this that it was the interviewer’s judgment 
which determined the shift in most of these instances. In later months his 
influence was less apparent. It was also found that whenever there was a 
difference between his rating and the final grade, the former was much 
more likely to be the higher of the two, which, as we have said earlier, 
indicates, if we assume that the final rating was our most valid figure, that 
there was a consistent tendency for each interviewer to overrate the men 
he interviewed. 

But^ of more significance than this determinant of the final rating of 
Effective Intelligence, as well as of all other variables, was the frame of 
reference, or the standard held in mind while making ratings. This is an 
important problem because if one’s frame of reference shifts there will be 
a corresponding shift in scale values and, therefore, in the distribution of 
the ratings. 

The crucial question is: were we able to maintain unchanged the scale 
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against which we rated the candidates throughout the program at S? Was 
our frame of reference— the standard we used in rating our candidates—the 
same in the last period as it was in the first? Here we have one finding 
which may be pertinent: when the final rating was different from the 
average rating, the former was much more often higher in the first few 
months of S, and much more often lou/er in the last few months. What is 
the explanation? Why were we disposed to boost a candidate in the early 
days and to bring him down toward the end? 

Looking back in retrospect upon the men we assessed, those of us who 
were at S throughout its entire history find ourselves in agreement on the 
following point: in the early days of S we were tremendously impressed 
by the quality of the candidates. Certainly there were exceptions, but by 
and large they seemed to us an uncommonly superior lot. Previously, most 
of our clinical experience had been with the ordinary run of people, and 
having derived our standard of the “average man” from them, we were 
prepared to feel that the OSS candidates were far above this standard. If 
this is what happened, one can understand why in the early days, when we 
did something other than accept a simple average of all ratings as the final 
grade on Effective Intelligence, wc moved the rating up rather than down. 
As we viewed our candidates in the first period at S within the frame of 
reference of the population we had tested in former days, they looked 
extremely capable, more capable, we would now guess, than they actually 
were. If there is any truth in this notion, then it is likely that our early 
experiences at S with superior candidates (at least superior in relation to 
our previous standard) gave us a new frame of reference in terms of which 
we rated subsequent candidates. If, as seems likely, during the last months 
of S the candidates were observed in relation to the first graduates, they 
must have suffered by this comparison, the earlier men having by then 
grown into legendary figures of great prowess. 

There is thus reason to believe that the scale for rating candidates changed 
with time and circumstance. Without a constant anchor, a steady frame of 
reference, we probably rated candidates too high in the earlier and too low 
in the later periods. Docs this mean that ratings will always be incomparable? 
At first to some extent, yes. But in so far as this effect can be recognized, 
corrections can be made for it, Only research into techniques of rating will 
reveal the ways in which this source of error can be reduced. 

EMOTIONAL STABILITY 

From first to last, the problem of emotional stability was a central issue 
in assessment, a vastly important consideration in predicting a candidate’s 
over-all effectiveness in the field. It was the variable of personality most 
subject to change, and if changed for the worse it could vitiate all the other 
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skills of a candidate. A man with an outstanding knowledge of labor 
organization in Europe could become valueless to the OSS if his emotional 
reactions to conditions of living overseas should be such _as Co interfere 
seriously with his operating efficiency. Similarly, a man who went to pieces 
while on an operational mission might prevent the success of the project 
and at the same time jeopardize the lives of his associates. It was not enough 
to know that a man’s motivation was high and his skills were adequate; 
we had also in the light of our assessment of his emotional stability to 
estimate what his operating efficiency would be when called upon to work 
under conditions of frustration and of danger to life and limb. 

Coupled with the focal importance of emotional stability in assessment 
was the necessity of having to evaluate this variable on something less 
than completely adequate objective test data. In a few cases there was 
sufficient evidence in a man’s history to preclude his being sent overseas, 
but for a man finally recommended there were never enough objective 
data to ensure that his emotional stability would remain unimpaiied in 
the face of unpredictable stresses. Given enough time, there was no mason 
why an adequate staff of psychiatrists and psychologists could not discover 
the emotional structure which underlay a man s manifest behavior, but 
in many cases the three-day period of assessment provided little moie than 
a rough understanding of the role and intensity of a man s affective life. 
The insightful candidate could provide us with highly important data to 
help round out our estimate of his emotional stability, but many of the 
candidates had little more than a banal and stereotyped conception of their 
own emotional dynamics. It was not enough, however, to grasp, as best 
we could, the emotional make-up of our candidates; we had to predict their 
probable performance in specific field assignments. This step never failed 
to challenge us, and though it was a judgment made on the best evidence 
available, it was never made with complete confidence as to its accuracy. 

A difficult task in the assessment of emotional stability was that of 
estimating the over-all temperamental sturdiness of a man as contrasted 
with his capacity for adaptation to specific conditions. If a candidate 
presented a history characterized by resilient and stable adjustment to the 
major problems'' of his life, and if the behavior which he manifested at S 
was consistent with this picture, there was little reason to expect that his 
adjustment to conditions overseas would be other than sound, especially 
if his motivation was high. Few candidates, however, presented such a 
uniform picture, and to send overseas only such sturdy individuals would 
have limited too severely the number of personnel available for the 
various OSS missions. Hence the question of specificity of adjustability 
entered into our considerations. Would the candidate with certain emotional 
strengths and weaknesses be able to adapt to the particular conditions of a 
particular job? One immediate difficulty into which we ran in attempting 
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to answer this question was, o£ course, the somewhat vague knowledge 
which we possessed of the specific stresses characteristic of the different 
assignments. Only in the most general terms did we know what a given 
recruit might encounter. Our realization in the latter part of the program 
that many candidates would be called upon to carry out assignments other 
than the ones for which they had been selected and for which we had 
assessed them served only to complicate our problem. 

Essentially our task was to predict the emotional stability of candidates 
in environments which had little similarity to any of those they had pre- 
viously known. Prior to the war, few Americans had ever lived completely 
isolated from their families, among natives who in their behavior expressed 
some friendliness but often open hostility, cut oil from contacts with indi- 
viduals of the opposite sex of their own age and culture, with marked 
limitations in food and housing, out of touch with many familiar American 
recreations and diversions, and under the constant stresses of danger to life 
and limb. These were the conditions of war, and each man, in his own 
way, had to adjust to them. Under these circumstances many familiar pat- 
terns of adjustment would prove inadequate; many customary modes of liv- 
ing would be impossible. New satisfactions and securities would have to be 
established. 

Accordingly, the genuine satisfactions which a candidate might find in 
his projected assignment became an important consideration in assessing his 
emotional stability. The quality and intensity of his motivation provided a 
preview of what he was seeking, but many times the motivation, as ex- 
pressed by a candidate, had all of the distortions of untrained subjective 
analysis. At best the satisfactions which might be achieved in the field 
would almost certainly be different from those anticipated by a candidate 
while undergoing assessment. When, however, the expressed motivation was 
clearly unrealistic there could be little hope that the candidate’s emotional 
stability would be equal to his inevitable disappointments and frustrations. 

Few if any of the candidates had a clear and concrete idea of what con- 
ditions in the field would be like and little conception of the months of 
training, the monotonous activity, and the days of waiting which lay ahead 
of them before their important work would begin. Unless they had had 
years of Army experience they could easily underestimate the inertia and the 
irritations they would experience. Once they were in the field, however, 
there would be experiences and satisfactions which could redeem the months 
of preparation. How much satisfaction would the candidate be able to 
derive from submerging himself in a cooperative activity as a member of a 
group? If he had a unique skill to contribute, what value would It have for 
him to improve that skill and to use it to best advantage for the aims of 
his mission? What would be the meaning for him of the close friendships 
which might be possible in the isolation of working behind enemy lines? 



284 Assessment of Men 

What satisfaction would it bring him to vindicate his self-reliance and his 
ingenuity in the face of evcr-changing obstacles and hazards? These ques- 
tions, which we tried to answer, suggest some of the possible satisfactions in 
OSS assignments overseas, and if a candidate could not avail himself of 
them, there were serious doubts about his continuing emotional stability. 

If a man^s motivation and affective needs could not be satisfied by the 
actualities in the field, there was reason to consider him a bad risk for over- 
seas work. 

Though emotional factors influence the operation of all personality vari- 
ables, Emotional Stability seemed to us to be most closely related to Motiva- 
tion and to Social Relations. We conceptualized these as separate variables, 
but dynamically none of them could ever be considered *ilonc. Motivation 
is a function of underlying emotional attitudes and needs, and, without 
stability in the underlying structure, motivation, no matter how high it 
may be in the moment, will not be of sound quality or of an enduring 
nature. Conversely, if a man's motivation is sound and realistic, there is 
reason to believe that his emotional dynamics are relatively stable. 

Good social relations, likewise, play a supportive role in the maintenance 
of high emotional stability. Few if any individuals can live with even 
minimum contentment without having a degree of acceptance by others. 
Lack of this approval is often an important direct cause for neurotic dis- 
turbances. And in the field situation, with its numerous privadons, accep- 
tance by one's fellows becomes highly prized and indeed essential. When a 
man has little skill in social relations there is an additional burden placed 
upon his emotional life. Conversely, if he can avail himself of group support, 
he has good insurance against other possible assaults represented by a stress- 
ful environment. Good social relations and the satisfaction they make pos- 
sible can compensate for other unfilled needs. Indeed, an individual s social 
relations and his emotional stability are so intimately connected that we 
have elsewhere raised the question as to whether they are not to be looked 
upon as two aspects of a more fundamental trait. (See Factor A, Table 
54, page 513.) Even when emotional stability was the focus of our concern, 
it was clear that it could never be properly evaluated without discovering 
how it was related to social relations and to motivation. 

The term '‘emotional stability” has connotations that may cause the reader 
to obtain a misleading impression of what it was we sought to conceptualize 
and rate under this heading. The discussion of the problems which con- 
fronted us in our attempts to rate the variable may have served to clarify 
the meaning we gave to Emotional Stability, but even so a further elabora- 
tion of the concept may be helpful and perhaps even necessary. Unfor- 
tunately the term suggests something stable and static, placid and even. 
As a phrase it may, to some, even connote the absence of emotion. Yet it 
was farthest from our thought that absence of emotion or even emotional 
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flattening is a sound and valuable tiait of personality. Almost every situation 
demands of the normal and healthy person some measure of emotional 
response, and there are many situations, especially in time of v^ar, which 
require violent emotional reaction, A high rating on Emotional Stability 
did not mean, then, the absence of emotion but primarily an appropriate- 
ness of emotion in both a qualitative and a quantitative sense. Emotion is 
dynamic, and, if integrated with action and directed toward appropriate 
objects, is helpful. It was, then, the integration and direction of emotion by 
the person which loomed large in our notion of Emotional Stability. There 
are a number of desirable emotions: for example, enthusiasm, affection for 
associates, hate of the enemy, and, in some cases, fear, if it leads to prompt 
coordinated action, all of which might stand a candidate in good stead in 
his assignment overseas. We looked for these in a man, and if he had them, 
so much the better. We did not rule them out of our conception of Emo- 
tional Stability, but it must be admitted that our focus in this variable was 
upon a man’s ability to manage emotions which might otherwise disrupt 
his behavior. It is probably fair to say that the core of Emotional Stability 
as we conceived it was a man’s governance of undesirable emotions. We 
looked for emotions that were not directed toward or integrated with 
actions that would further the success of a man’s assignment and so caused 
conflict which would be incapacitating (e.g., anxiety, phobias), or, if 
objectified in behavior, would lead to undesirable results (e.g., flight from 
the enemy, anger against associates, dereliction of duty). Signs of such 
emotion beyond the control of the subject we took as evidence of emo- 
tional instability and accordingly rated the subject low. 

Concerning a man’s emotional stability there were two questions to be 
asked: (i) Do undesirable emotions occur frequently and intensely? (2) If 
such emotions do occur, can they be held in check or canalized in desirable 
directions? If our answer to the second question was positive, then our rat- 
ing of Emotional Stability would be raised, but an affirmative answer could 
be given only for those cases in which there was evidence, usually from 
the Interview, of superior dynamic structuration (e»g*) regnant organiza- 
tion, ego strength) of the personality. 

Ultimately, then, our rating of Emotional Stability was an estimate of 
the extent to which a man’s performance in the field would be affected by 
emotional factors for better or for worse. If a candidate had optimum Emo- 
tional Stability, his energies and abilities could be devoted completely to 
the task at hand without concern on his part as to how he was doing or 
what others might think of him. He could consider the situation confront- 
ing him for what it actually was and would not be distracted by hard- 
ships, or frustrations, or the personalities of those around him. Though no 
one probably ever possessed this degree of imperturbability, it represents 
the broad conception which guided our final rating of this variable. Our 
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conception might be called an cflicicncy rating of emotional maturity for 
the sn-esses of field work. Within this broad definition was included a 
man’s potentiality for a ncuropsychiatric breakdown. No other development 
could so completely make a man valueless to the organization and indeed 
a distinct liability to the immediate group in which he worked. In the 
sense that every man has his breaking point the whole range of our rating 
scale represented this prediction. But in practice only the lowest third of the 
scale implied the possibility of a crippling breakdown. For the remainder 
of the scale the emphasis was on varying degrees of emotional efficiency 

on die job overseas. _ . 

Another consideration which entered into our rating of Iimotional Stabil- 
ity— though partly subsumed under the rating of Social Relations— was 
the effect which a man’s affective reactions might have on group morale 
and the stability of others. One familiar technique for_ ridding oneself of 
anxiety, if only temporarily, is that of turning it out in irritability, com- 
plaining, and hostility directed toward others. This capacity to "turn out- 
ward” his anxiety might in some cases be the crucial factor in an individual’s 
maintaining a moderately good working efficiency. If, however, the extent 
of a candidate’s impairment of group efficiency seemed likely to outweight 
the contribution which, in other ways, he might coiiceivalily make, it seemed 
wise not to recommend him for an overseas assignment. 1 he fact that poor 
social relations of this type arc so clearly the result of emotional instability 
explains why this pattern of adjustment was considered in our rating of 
Emodonal Stability. 

A final concern in scoring a candidate's Emotional Stability was the 
possible presence of psychopathic traits. This factor might seem to match 
only roughly our concept of Emotional Stability since the psychopath, in 
the nature of his over-all adjustment, might be stable, in the sense that he 
would not develop symptoms under the most difficult conditions. And, If 
his motivation were high, he might be able for a while to perform efficiently. 
But all things considered, psychopaths could hardly be considered assets 
to the organization. Their irresponsibility and antisocial tendencies would 
quickly make them a liability to the group. In most cases they could not 
be depended upon to make a solid contribution, and they might even 
jeopardize the lives of others. After all it is the p,sychopath, [lac excellence, 
who lacks governance of emotion and impulse, and this was crucial to out 
concept of Emotional Stability. When such a deviation in character as 
psychopathy was uncovered during assessment, the candidate who possessed 
this particular lack of fitness was rated inferior in Emotional Stability. 

During the assessment period there were three major sources of data 
regarding a candidate’s Emotional Stability: the Interview, the situations, 
and casual observations. The Interview brought together a candidate s 
projective material, his various inventories, and his personal history form. 
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since all of these were considered concurrently with and interpreted in 
the light of his life history data and the impressions gained of him during 
the Interview. The situations which were relevant for the estimation of 
Emotional Stability were Construction, Stress, and Post-Stress. A supple- 
mentary but very important source of data was the incidental observation 
of candidates in the other situations and in the informal social life at S. 
By all odds, the opinion of the interviewer concerning a man’s emotional 
stability carried the greatest weight in our deliberations. But each of the 
three sources of data contributed in a complementary fashion to the judg- 
ment represented by our final report and final rating. 

The Interview provided the widest range of data both as to developmental 
history and as to the various levels of affective attitude. It supplied the 
frame of reference within which a candidate’s responses to stressful situa- 
tions and his informal behavior during assessment were to be understood. 
Our conception of the dynamic structure of a candidate’s personality, as 
well as our final judgment of his stability, was derived in large measure 
from the evidence gathered by the interviewer. As compared with the 
other personality variables, Emotional Stability depended by and large upon 
the judgment of a single staff member, the interviewer. His was a grave 
responsibility indeed. 

The situational tests were designed to evoke responses to provoking and 
stressful stimuli. There was no thought that they would supply us with 
true work samples, nor were the provoking situations closely similar to any 
that might be anticipated in the field. They were, in a sense, caricatures of 
field situations. Had the situations in our tests been more conventional 
and less provoking, the returns from them in the way of personality data 
would have been diminished considerably. There was no expectation that 
the emotional response to the provocation would be a direct and unequivocal 
manifestation of our conception of Emotional Stability. Invariably the 
behavior In the situations had to be interpreted in the context of the data 
gathered from all other sources; by itself it might mean a great deal or 
virtually nothing. Occasionally a candidate would make a creditable and 
stable response to the stressful situation of a test and yet, in the final judg- 
ment of the staff, have poor promise of emotional stability in the field. 
Conversely, some of the candidates who seemed, on other scores, to possess 
stable and mature emotionality were genuinely, though perhaps superficially, 
upset during the provoking situational tests, 

The importance of the incidental observations which were made during 
an assessment period lay mainly in the fact that they provided a wide 
sampling of manifest behavior in re.spect to poise, social self-confidence, 
and apparent social needs. They yielded a picture of the manner in which 
a candidate handled himself when little more was required of him chan 
that he be a social being. In many cases, a candidate’s patterns of social 
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response gave significant clues to his underlying emotional make-up. These 
informal observations usually provided less for the interviewer working with 
the candidate than for the other members of the staff, for whom they were 
especially important. Occasionally, however, a candidates mtormal social 
behavior supplied us with the key which made possible a credible interpre- 
tation of the over-all pattern of his personality. i i r t 

Since the interviewer's judgment so very largely represented the final 
evaluation of a candidate’s Emotional Stability, it is worth while to con- 
sider how he came by it. Before embarking on the Interview, he briefed 
himself for it by a perusal of the candidate’s Personal History Form, the 
projective material, the various inventories, and the Work Conditions Survey. 
The Personal History Form gave a longitudinal view of the candidates per- 
sonality and some information about his education and work experience. 
The bare outline of the family constellation in which the candidate was 
reared was often provocative, both of tentative interpretations and o 
issues to be settled later in the Interview. From the projective material— 
mainly the Sentence Completion Test and the Projective Questionnaire— 
a provisional interpretation of overt and covert behavior patterns was made. 
Any atypical clustering of answers in the inventories raised additional 
hypotheses and questions. Finally the Work Conditions Survey incucated 
preferences expressed by the candidate regarding conditions which he 
thought would make for his best performance in the projected assignment. 
All of these sources of information yielded a preview of the candidate s 
personality and though this picture was often changed significantly by sub- 
sequent data, the interviewer was prepared by it to make the best use of 
the interview. With these basic data at hand the interview could quickly 
become an exploration for the less obvious facets of the candidates per- 
sonality. 

Necessarily each interviewer had his own methods for establishing rap- 
port, for keeping the interview moving, and for making the transitions 
from one area of personality to another. One important early consideration 
was to get a clear picture of the family and the personalities of those who had 
exerted the first major influence upon the candidate. It was recognized that 
the character structure nurtured in this early setting represented the basis 
for future growth. The next important consideration was the direction of 
development and change which the candidate’s personality had taken by 
virtue of starting school, a changing family constellation, and other major 
life experiences. Appearance of neurotic symptoms during any of these 
transitions was suggestive of the degree to which the experiences them- 
selves had not been assimilated, leaving the personality vulnerable to sub- 
sequent traumatic experiences. The sheer severity of these crises was less 
important than the manner in which they had been handled and the new 
directions which the personality had taken as a result of them. During the 
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formative years each new major experience leads to a reintegration of the 
personality, either in the direction of further strength and resiliency or in 
the direction of [)ersistent maladjustivc reactions and a narrowing of activ- 
ities and interests. In the case of many candidates, because of their relative 
youth, the pnd)lem of emancipation from the home merited considerable 
attention. If this transition had been carried through successfully it was 
strong indication that previous crises had been handled well. However, 
beneath this pattern of emancipation it was always valuable to know what 
the personality was moving away from and what it was moving toward. 
No matter what transition nr major experience was considered, it was im- 
portant to know what residues of earlier behavior patterns were involved. 

If there was evidence that an individual tried invariably to utilize an earlier 
pattern of adjustment for succeeding experiences, his subsequent adjustment 
was judged likely to he precarious and restricted. 

In the ideal Interview the ‘‘revisiting” of a candidate’s major life experh 
enccs provtjkecl a greater variety of feelings than would have appeared had 
it been limited to a discussion of his current preoccupations. From such 
discussions of the [)ast one cciuld often estimate how well the early experi- 
ences of a candidaie had been assimilated. Regardless of the particular 
topics which might come under discussion, the Interview was an interper- 
sonal experience for the candidate which was likely to evoke attitudes 
and behavior patterns whicli also ojicrated in his other relationships, Much 
of a candidate’s typical behavior was here either adumbrated or clearly 
expressed. 

In so far as he was highly motivated, a candidate usually tried to give the 
best possible picture of himself. It was the interviewer’s task, however, to 
see behind this facade. The candidate’s frankness, objectivity about himself, 
and the ebb and flow of anxiety as he discussed various topics of a personal 
nature were invalual)le cluCvS to his present emotional maturity and stability, 
His blind spots and his exaggerated feelings, prejudices, or resentments, if 
they appeared in the Interview, were important signs of how much of a 
residue of earlier [Kiticrns of adjustment still operated in the present person- 
ality. Particularly important was the way in which the candidate handled 
whatever anxiety appeared. Was he defensive, apologetic, submissive, re- 
sentful, or hostile towanl the interviewer? Did the anxiety seem to radiate, 
once it had been arou.scd, over a great variety of topics, or was it limited to 
specific topics, disappearing when those topics had been discussed? Was his 
present pattern to turn the anxiety inward with resulting self-recrimination 
and depressed moods, or did he readily displace it onto his surrounding en- 
vironment? The answers to questions such as these were high lights of the 
Interview, the importance of which could hardly be exaggerated. 

There was, of course, wide variation in the fruitfulness of the Interview 
as a source of data. Despite high motivation for an OSS assignment, some 



290 Assessment of Men 

candidates covertly challenged the interviewer to find out anything about 
them, They felt that their past experiences and the intimate aspects of their 
present personalities had nothing to do with evaluating their fitness for 
their proposed assignments. Notwithstanding the good intention and the 
patient effort of an interviewer) suggested leads for discussion often led to 
noncommittal statements and verbal blind alleys. In these cases the evalua- 
tion of emotional stability was more difficult to make and depended in large 
measure upon the nature of the candidate’s manifest behavior in tlie social 
life at S, the character of his response to stressful situations in the program, 
and the presence or absence of severe personality distortions in his projective 
material If these additional sources of data suggested a favorable stability, 
the candidate might be recommended for overseas duty. If, however, this 
reticence about himself was a consccjucnce of a severely constricted and 
repressed personality, the likelihood of his maintaining emotional stability 
in the field was estimated to be low. Such cnndidales, however, were always 
difficult to assess, and we never made our ratings of them with any sense of 
confidence. 

Physical symptoms with a possible psychogeiicsls were considered very 
seriously in making the Emotional Stability rating. Occasionally a single 
such symptom, e.g., severe headache, might disqualify a candidate If it was 
likely to be set off by conditions to be found in the field, If, however, the 
symptom was seemingly precipitated by something in the candidate s domes- 
tic life, e.g., marital unhappiness, it might not by itself preclude his operat- 
ing efficiently overseas. In any case we deemed it necessary to get some 
understanding of the origin of symptoms and their unconscious meanings. 
Any single mild psychosomatic involvement might not be important, but 
a host of mild complaints almost certainly would be. 

The interviewer, because of the greater amount of material available to 
him, was considered the most reliable person to assess and evaluate the 
candidate’s stability. As a result, the interviewer’s ratings of Emotional 
Stability carried the greatest weight of all ratings of this variable. The 
correlation of interviewers’ ratings of Emotional Stability with the final 
ratings of the variable ranged between .89 and .94 for the various periods, 

The distribution of interviewers’ ratings of Emotional Stability for Periods 
F-G are presented in Table 16. It can be seen that the desideratum of a 
distribution of 7 per cent of the ratings in the Very Superior and Very 
Inferior categories, 18 per cent in the Superior and Inferior categories, and 
25 per cent in the High Average and Low Average categories was not 
attained. This failure was largely due to the fact that certain of the ratings 
acquired specific meanings as assessment progressed. In the last months of 
the program it had become the practice to assign ratings of 0 to those candi- 
dates who had had a psychological breakdown from which they had not as 
yet fully recovered, and to those who were presently struggling with frank 
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psychoneurotic and psychosomatic disturbances. Ratings of i were usually 
reserved for those unstable candidates who, though less disturbed than those 
rated o, presented so great a risk that they could not be recommended for 
their projected assignments. At the other extreme, ratings of 5 were 
assigned to those individuals who were so well integrated and so well 

TABLE 16 

Distribution of Interviewers’ Ratings of Emotional Stability in 
Terms of Percentage 
{Periods V-G; N=442) 

S Scale ^ 

o I ^ 3 4 5 

1.5 7.1 31.4 36.Z 19.0 Z.7 

adjusted that there was thought to be practically no chance of their break- 
ing down. Since most of the candidates had already been through the screen- 
ing provided by induction centers and the Army, and since the staff was 
reluctant to assign Very Superior ratings (since for few candidates could 
the possibility of breakdown be definitely excluded), it was to be expected 
that the ratings assigned by the interviewers would cluster in the upper- 
middle range of the scale. 

Among our situational tests, the Construction Test was designed primar- 
ily to test the reactions of a candidate to ^‘snafu,” to belittling and in- 
sulting remarks, and in addition to provide some indication of his ability 
to manage recalcitrant, irritating, and stupid subordinates. The social 
atmosphere during Construction was so challenging that before the test 
was over the candidate was called upon to demonstrate a considerable 
range of his social and emotional patterns of adjustment. 

The ratings of Emotional Stability in Construction correlated .44 
(]V = 44o) with final ratings of this variable for Periods F-G. Indeed, if 
one considers only the magnitude of this correlation, one might well ques- 
tion why the Construction Test was retained in the battery. The truth is 
that the value and importance of the situational tests in this battery are 
not readily discernible from the correlations between the ratings of Emo- 
tional Stability based on them and the final ratings of this variable. Their 
contribution was a more qualitative one. The Construction Test, for example, 
was invaluable in high-lighting certain specific aspects of personality, In 
one case it might be “snafu’* tolerance, in another a sense of humor, in a 
third, objectivity that would be revealed by the test. But each of these was 
only an aspect of the total personality. It was unwise and impossible to 
generalize about an individual’s Emotional Stability from any one experi- 
mental situation. The final rating on Emotional Stability had to be deter- 
mined by a multitude of factors, and since only one, or at most, several, 
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of these factors could be observed at any one time in a situational test, it 
is understandable why the correlation between ratings made in situational 
tests and final ratings of the same variable was not over .50 for any one 
of the periods. 

The Stress Interview was the second situation in which evidence regard- 
ing Emotional Stability was gathered. There were two serious limitatioas 
of the Stress Interview as a test of Emotional Stability. On the one hand, 
the range of possible behavior which might be sht)wa by the candidate in 
this situation was restricted, being largely confined to the verbal level. The 
physical expressions of instability were always noted, but often it was dif- 
ficult to tell how significant they were or how they were to be interpreted. 
If a candidate became visibly confused or blocked in his speech, it was 
significant, but this symptom appeared only occasif)nally. Many times we 
were hard pressed to agree upon the meaning of behavior observed. Another 
limitation of the Stress Interview as compared with the CcJiisiruction Test 
was that the artificialities of this situaUon were more obvious and some of 
the candidates clearly did not take it seriously. If those particular candidates 
were also fairly resourceful they often made a commertdable showing. Yet 
despite these linaitations of the Stress Interview, it served to arouse emotion 
in many candidates and provided the staff with an opportunity to observe 
the ways in which candidates handled their anxieties. Although a candidate 
was attacked less personally in Stress than in Construction, here also he was 
on the spot so far as maintaining an intelligent and stable performance 
was concerned. The efficiency of his thinking under these conditions was 
certainly an aspect of our concept of Emotional Stability. 

The correlation between the ratings of Emotional Stability obtained dur- 
ing Stress and the final ratings was of approximately the same magnitude 
as that obtained for the Construction Test. It was .46 for Periods F-G 
(iV=437). 

In the Post-Stress situation which immediately followed Stress, the im- 
portant questions for the interviewer to answer concerning Emotional 
Stability were: How intensely had the candidate licen aroused? What was 
his reaction to the test and his opinion of Its purposes? What direc- 
tion did his resentment take? What was his reaction to failure? What 
mechanisms did he have for assimilating the experience? Another question 
to be answered in Post-Stress concerned the manner in which a candidate 
construed this new situation in which he could talk over his experience 
with a sympathetic staff member. Were his emotions so overflowing that 
he immediately started talking as though X conditions now prevailed, or 
did he realize that without permission he must continue to handle himself 
within the limits of his cover story? 

Though Post-Stress had no new provocations for the candidate — unless 
he were suddenly pulled up short in assuming X conditions — its importance 
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for gauging his Emotional Stability was that it aEorded a picture of what 
went on in him subjectively when emotion was aroused. Here one could 
get a view of the emotional dynamics of a man when he had not had time 
to absorb an experience or achieve a sense of distance from it. To this 
extent it supplemented the Post-Construction Interview and the subject’s 
own analysis of his emotionality in the Interview proper. The ratings of 
Emotional Stability in Post-Stress correlated with the final ratings of Emo- 
tional Stability .36 in Periods F-G (^ = 439). 

The final source of data on Emotional Stability was the constant, informal 
observation of candidates during their stay at S. Essentially the value of 
casual contacts with a candidate in the nontest situations lay in their con- 
tribution in many imdefinable ways to the picture of the man’s total per- 
sonality. Most behavior has some affective tone if the observer is perceptive 
enough to see it; and in assessment, where the competitive element was 
strong, the affective coloring of behavior was obvious. A candidate’s pattern 
of social response gave one of the best pictures of the emotional support 
which he needed from his fellows and of his techniques for achieving it; 
likewise the degree to which he displaced his anxieties in the way of criti- 
cism, irritability, and open hostility was also revealing. Did he need ac- 
ceptance hy others to the extent of being painfully submissive and deferen- 
tial? Or did he need to dominate others with apparent indifference to their 
feelings toward him ? Each candidate in his unique way possessed a pattern 
of deference and dominance. The extent to which he was tolerant and 
forebearing was often a sound indication of a man*s emotional maturity. 
The peculiar value of observing informal interaction of the candidates was 
that during assessment they did not have the familiar props for maintaining 
personal security and influence which were present in their normal lives. 
In this anonymous community, each man, depending upon his genuine self- 
confidence and his emotional and social resources, established his own social 
role. 

One valuable bit of information which can be subsumed under the rubric 
of informal observation was a subject’s response to alcohol during Im- 
provisations and Debate. Upon occasion some quite unexpected behavior 
appeared which furnished the basis for a decided change in the rating of a 
candidate’s Emotional Stability. A candidate who through sheer effort had 
made a creditable showing up to this point in assessment, only to become 
quite irresponsible and exhibit an ugly truculence while intoxicated, could 
hardly be considered to possess adequate emotional stability for an overseas 
assignment. 

A relationship that is high-lighted in the table of intercorrelations of rat- 
ings of Emotional Stability is the sharp dichotomy between the correlation 
of the interviewer’s ratings and the final ratings of Emotional Stability and 
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the correlation of the final ratings with ratings in the situational tests 
(Table 6r, page 519). These figures express statistically two facts: first, that 
the interviewer’s rating of Emotional Stability was the most important single 
rating of this trait; second, that the interviewer’s rating was based on data 
largely different from those obtained in the various situations. 

If we placed so much reliance upon the ratings of Emotional Stability 
given by the interviewer one might ask why we devoted so much time and 
energy to observing candidates in our different situational tests and rating 
them In these situations. Since we made so little use of these ratings were 
they worth the time and effort spent in making them? The answer seems 
to us to be yes, and for four reasons. First, the situations frequently evoked 
behavior which served to corroborate or to negate a tentative hypothesis 
which the interviewer had made about a candidate after seeing him in the 
Interview, Second, upon occasion situations rcvealecl specific liabilities or 
assets not previously discovered by the interviewer. Situations contributed 
to our knowledge of our candidates. Third, since the situations were to 
some degree standardized, they provided the opportunity for a more effective 
comparison of the behavior of candidates than would have been possible 
without them. Fourth, the situations provided occasions upon which several 
staff members observed the behavior of candidates, placing them in a posi- 
tion to question, if not to correct, the biases and prejudices which some- 
times crept into the judgment of the interviewers. Ac S, due largely to our 
situations, the interviewer was not allowed to speak ex cathedra. 

The table of intercorrelations of final ratings (Table 58, page 516) re- 
veals that Social Relations correlates with Emotional Stability more highly 
than any other variable (.54). This finding supports our earlier theoretical 
statement of the close relationship between these two variables whereby 
each supports to some degree the other. The relatively high corre- 
lation between final ratings of Emotional Stability and those of Leader- 
ship (.45) is not surprising, for although one can conceive of emotionally 
unstable leaders, in general one would expect to find enduring qualities of 
leadership rather dependent upon a dynamic organization of personality in 
which desirable emotions would predominate and in which there would be 
an effective integration and direction of emotion toward appropriate ends. 
One might expect to find a relatively high correlation between Emotional 
Stability and Effective IntelUgence in so far as one would assume that supe- 
rior dynamic structuration of personality, one aspect of which is Emotional 
Stability, would depend in part upon Effective Intelligence (knowing what to 
do and how to do it, and the like). Actually the correlation of the final ratings 
of these two variables, .24, suggests that Effective Intelligence did not enter 
to an important degree into our conception of Emotional Stability, at least 
as that conception found expression in our rating of the variable. The 
correlations of Emotional Stability with Physical Ability (,31) and with 
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Security (.32) are of about the expected order of magnitude. Some measure 
of physical skill should contribute to emotional stability in so far as it should 
lessen for a person the number of areas in which frustrations are apt to be 
experienced. One expression of governance of emotion should be control 
of one’s tongue and of one’s egocentric drives; thus the correlation between 
Emotional Stability and Security. There is no reason to believe that Observa- 
tion and Reporting as conceptualized by us should be significantly related 
to Emotional Stability. The correlation of .15 between these two variables is 
in agreement with expectation, The lowest correlation is that between Emo- 
tional Stability and Propaganda Skills (.09). In view of die fact that a large 
percentage of candidates recruited for work in subversion of morale were 
artists and writers, this extremely low correlation should come as no sur- 
prise. Whether these figures reveal the true relations between the correlated 
variables or merely reflect stereotypes in our minds is, of course, a question 
which a matrix of intercorrelations cannot answer. 

SOCIAL RELATIONS 

The success of any organization depends in large measure upon the ability 
of its members to function as a harmonious body with the minimum of 
friction and irritation. It is therefore not surprising that special attention 
was paid to the social relations of our assessees. While we did not expect to 
be able to duplicate the stressful conditions prevailing in the theaters of 
war, nevertheless we hoped that by confronting the candidate with the 
necessity of adjusting quickly to new people in new situations a fair sample 
of his habitual social attitudes and actions and his effects on others would 
be obtained. This, we thought, would provide us with sufficient basis for 
predicting the candidate’s disposition and ability to function as a member 
of some group overseas. 

During Period A one of the twenty-odd traits which were systematically 
rated was called Getting Along with Others. At the beginning of Period B 
this variable was given a more precise definition and renamed Social Rela- 
tions. On the Face Sheet it was described as “social awareness, good will, 
team work, tact, absence of annoying traits.” Except for the subsequent sub- 
stitution of “discretion” for “social awareness,” this definition, designed for 
the benefit of administrative officers and their chiefs, was never altered, It 
consists of a list of traits or subtraits which were selected as most conducive 
to the establishment and maintenance of congenial, trustful, and effective 
interpersonal relationships within the framework of the OSS. Thus the chief 
point for decision was not so much the presence or absence of these traits 
as the probable effect of the candidate on the morale of the unit to which he 
was likely to be assigned. We would ask ourselves, Is he the kind of man 
whom others will want as a member of their group? 
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There is not much difficulty in distinguLshinjr those who get along well 
with almost everybody and those who get along nvcII with almost nobody, 
but most people do not fall at one or the other of thcvsc two extremes. The 
average OSS candidate, at any rate, was a man who cciuld lit harmoniously 
into some groups but not so harmoniously into others. Consequently, in 
most cases, a knowledge of the personalities composing each OSS unit was 
a prerequisite for accurate predictions. Only in a few instances, however, did 
the members of the staff at S have a reasonably congruent conception of 
the nature of the group in which the candidate had been selected for mem- 
bership. In the vast majority of cases their conceptions were necessarily 
vague, and, as a result, they had to decide to what extent each candidate 
would be acceptable to most people, rather than to some designatccl group. 
Another reason for a general, instead of a specific, statement was that most 
individuals were shifted several times from one group to another during 
the course of cheir careers in OSS and no one could predict these shifts 
in advance. Furthermore, the complexion of each unit changed with changes 
in its memberships; in the theaters new groups were formed overnight and 
old ones were broken up. Consequently, almost every member of the OSS 
had to adjust to a fairly fluid human situation. Moreover, the variable Social 
Relations included the ability to get along smoothly with members of other 
OSS units, with the British, the French, and the Chinese, and, not in- 
frequently, with some resistance group in occupied territory. Reports of 
assessed candidates would be brought back from overseas in which the man 
had been rated Superior in Social Rclauons by one group and Inferior by 
another; but since, as we have said, there was no possible way of foretelling 
the social dispositions of each candidate’s future associates in the field, we 
were not in a position to make predictions that would cover cases of this son. 

Another difficulty was the estimation of enduring acceptability, as dis- 
tinguished from initial acceptability. Some people are appealing on first 
acquaintance and can maintain for three or more days, if necessary, an 
agreeable social “front,” but, as time goes on, their annoying characteristics 
emerge, one by one, and the feelings of their associates change from positive 
to negative. In contrast to men of such short-lasting popularity are those 
who, at first, produce a rather neutral impression, but who, in due course, 
manifest qualities which inspire affection and respect and end by being 
widely appreciated. In a three-day program, no matter how suspicious the 
staff may become of glad-handers and hail-fellows-well-met, it is not always 
easy to spot the affable man who will eventually get on everybody’s nerves 
and to rate properly the inconspicuous and diffident fellow who will some- 
day be the best-liked man in his outfit. In rating each candidate on Social 
Relations, the question, ‘Will this man wear well?’ is always appropriate. 

Among the procedures that were used to measure Social Relations at 
Station S, the Interview was, as always, of first importance. By tactful and 
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Indirect i^ucstioning of the subject, a considerable amount of information 
could usually be obtained about how well he had gotten along with others 
in the past— in school, in business, in the world at large, in the armed 
services. As the candidate talked, the interviewer would invariably arrive 
at some impression of his social reactions and the efEects he produced, an 
impression based, if on nothing else, on his attitude and manner in the 
existing face-to-face situation, 

Judicious questioning might elicit that the candidate had left his last 
three jobs because he could not gel along with his superiors or associates; 
or it might indicate that for the past ten years he had worked successfully 
at a delicate liaison job. He might be extremely cooperative and friendly 
during the Interview, or he might be gruff, sullen, and impertinent. It might 
be determined that he was a dependent individual, wanting, and therefore 
always going out of his way in seeking, to be accepted by others; or that he 
was a highly independent self-sufficient person who preferred solitude to 
sociality* 

From the wealth of data obtained in the Interview, it was the task of 
the interviewer to predict the nature of the candidate’s interpersonal rela- 
tions with those who would be his associates in OSS both in the United 
States and overseas and then to express that prediction in the form of a 
rating, as well as to formulate it in words in writing the personality sketch. 

That it was the interviewer who formed the clearest impression of a 
candidate’s social relations or that it was he whose opinion carried the great- 
est weight at the staff conference is suggested by the fact that the inter- 
viewer’s rating of Social Relations correlated more highly with the final 
rating of the trait (.6()) than did any other rating of it (.39 to .62). It is of 
course to be remembered that the interview rating on Social Relations was 
made late in assessment after the interviewer had seen the candidate in 
various situations, and this grade incorporated the interviewer’s total im- 
pression of the student. 

Ratings of Social Relations were also made in four group situations, Two 
of them outdoors, Brook and Assigned Leadership, offered an opportunity 
to observe the candidates cooperating in the solution of physical problems 
while two of them indoors, Discussion and Debate, made it possible to see 
how they worked together when confronted with an intellectual problem 
which required only a verbal solution. Most of the correlations between 
the ratings of Social Relations given in these situations and the final grades 
are of approximately the same magnitude (Brook .50; Assigned Leader- 
ship .56; Discussion .52; Debate .56), and, interestingly enough, of a higher 
magnitude than the correlation between ratings in the Construction Test 
and final ratings (.39). Probably in arriving at the final score on Social 
Relations less attention was paid to the way the candidate had treated the 
stooges in Construction than to the way he had reacted to his associates in 
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the group situations, and this, we think was as it should have been, for 
Construction, because of the peculiarity of the stooges’ behavior, was less a 
test of the candidate’s tact and cooperativeness than of his emotional stabil- 
ity and snafu tolerance. 

Up until the last period at S, the Judgment of Others Test (the writing 
of personality sketches of five candidates) was included in the Social Rela- 
tions battery. It was incorporated at first because it was thought that the 
ability to size up other people is probably correlated positively with the 
ability to maintain smooth interpersonal relations. Experience proved that 
this was true, but to a much slighter extent than we had expected. In a 
great many instances there was a wide gap between knowing and doing in 
the realm of social relations. An analysis of our data after Period A revealed 
that Judgment of Others correlated lower with the final grade on Social 
Relations than any other test of this variable. In Period F, for example, 
the correlation was .36. Furthermore, in an inspcctional analysis of the 
intercorrelations, Judgment of Others stood out as something quite unique. 
The decision finally made toward the end of S to drop judgment of Others 
from the battery was based on these two empirical facts* 

Relatively early in the program at S a sociomctric questionnaire was de- 
veloped and incorporated in the Social Relations battery, Its primary purpose 
was to obtain from all candidates statements of how well they liked each 
of their colleagues. This, it would seem, is the real criterion of Social Rela- 
tions. But, if we could get this information at firsthand from the candidates 
themselves, why did we contaminate it with our own judgments? There 
are several reasons: 

1) We had no reason to believe that every candidate was a sufficiently 
good judge of others to say definitely which of his associates were men 
with whom he and others could work pleasantly and without friction. 

2) There was no gainsaying a candidate’s social acceptance or rejection 
of certain associates, but it had to be remembered that these reactions were 
based on three days of living together and might well be reversed after 
longer acquaintanceship. 

3) There was always the possibility that candidates were not completely 
forthright in answering the questionnaire. They might very understandably 
hesitate to express unfavorable opinions about associates to members of an 
assessment staff. (The frequency with which critical comments were made, 
however, would seem to indicate that this is a very weak objection to rely- 
ing on the results of the sociometric questionnaire.) 

4) The sociometric judgments were made by one group and with cer- 
tainty held only for this particular group. In making a final decision we 
had to bridge the gap between this group and all other groups in which the 
candidate was likely to live as a member of the OSS. One might question 
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whether the reactions to the candidate in outside groups would be as differ- 
ent from the reactions of his associates in his class as we sometimes imag- 
ined; or, if there was an appreciable difference, whether this would be 
larger than the error introduced by our judging his ability to get along with 
others rather than leaving the decision, in effect, to his present associates. 
It seemed to us, however, that we on the staff, and especially the inter- 
viewer who had gathered the history of the candidate’s social relations in 
many and varied situations of the past, were in a better position than the 
candidate’s associates to generalize from the present (and the past) to 
future situations. 

5) Finally, as psychologists and psychiatrists, we inevitably thought 
(whether rightly or wrongly, we cannot say) that, by and large, our insights 
into and judgments of the personality structures of our candidates and of 
the social relations determined by them were likely to be better than those 
of most candidates; and so in cases of disagreement we did not find it 
difficult to rationalize the acceptance of our opinions rather than those of 
the candidates. 

That the ratings of candidates given by their associates differed appre- 
ciably from those made by the staff is indicated by a correlation of .26 be- 
tween the sociometric ratings and the average of ratings given in the 
various situations by the staff. Perhaps this relatively low agreement is a 
result of the fact that the candidates rated their associates on the last day 
of assessment, with the benefit of two and a half days of observation and, 
especially, after the impressions gained in Improvisations and Debate, while 
most of the ratings in the situations were made by the staff earlier in the 
program. 

Our figures show, however, that we were not flagrantly partial to our 
own opinions, although it is clear that we favored them. For example, the 
correlation between interviewers’ ratings and final grades in Social Relations 
is .69, while the correlations between ratings by associates (positive and 
negative, respectively) and final grades are .62 and .55. Despite the 
difference between the situational ratings given by the staff and the 
sociometric ratings given by the candidates, there seems to have been con- 
siderable agreement at the end between staff and students in their estimates 
of a candidate’s Social Relations. 

A study of the correspondence between the final rating of a candidate’s 
Social Relations and the recommendation made to his branch concerning 
his disposition has revealed a number of interesting facts which indicate 
the important role of this variable in determining the S decision. These 
facts, based upon an analysis of all cases in Periods B, F, and G, may be 
briefly summarized as follows: 

i) If a candidate received a 5 on Social Relations, he was always recom- 
mended, often highly. 
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2) If a candidate received a 0 on Social Relations, he was almost never 
recommended for service overseas. 

3) If a candidate received a 4 on Social Relations, the chances were about 
14 to I that he would be recommended, although almost every decision it 
was possible for us to make was made, at one time or another, for ratings 
of 4. 

4) If a candidate received a i on Social Relations, tlie chances were about 
3 to I that he would not be recommended. The chances that he would be 
recommended with qualifications were i to 9. 

5) A comparison of Period B with Periods F and Cj slunvs that a tendency 
to give greater weight to poor social relations in making our final decisions 
developed during the later periods. Toward the end of the program it was 
rare indeed that a person rated 0 or i in Social Relations was rccomended. 

6) Toward the end of assessment, ratings of Social Relations^ with almost 
no exception, bore the following relationship to the final decision*. 


Rating of Social Relations 

0 and I 
2 and 3 
4 and 5 


Decision 

Nut recommended 
Almost any decision possible 
Recorntnended in some form 


A second minor study, unfortunately inconclusive in its findings, but 
nevertheless suggestive, was made of the relationship between the present 
Social Relations as rated at S and the character of the early home environ- 
ments of the candidates. An analysis of the personality sketches of fifty 
subjects who had received extreme ratings on Social Relations revealed a 
tendency for high ratings (4 or 5 on this variable) to be associated with a 
happy, affectionate childhood situation, and low scores (0 or i) with an 
unhappy, insecure childhood. This relationship, however, was not sufficiently 
clear cut to provide a criterion for individual predictions. 

The analysis further showed that more than half of the candidates who 
had received low ratings on Social Relations also had feelings of in- 
feriority, lacked confidence, and tended to be worried, depressed, or de- 
pendent, These characteristics were never reported for candidates rated 
high on Social Relations. The latter, on the contrary, were generally de- 
scribed as confident and secure, or at least, as making progress in overcom- 
ing sensitivity and insecurity, phrases never used to describe the emotional 
adjustment of those who had been marked low on Social Relations. 

Although the inadequacy of our data precludes generalizations, our 
findings suggest an hypothesis to be tested in some future program of 
assessment where data can be gathered with a view toward answering spe- 
cific questions. Here we can do no more than report our clinical impression 
—if not first gained at S at least strongly reinforced by the observations 
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made there — that the social relations of an individual and his emotional 
stability are mutually dependent. This ^vould apply particularly to situations, 
such as the war situation, in which men must work together under stress. 

This hypothesis is supported by the finding that in Period B, Social Re- 
lations correlated with Emotional Stability .43, higher than it correlated 
with any other variable except Leadership (,6i); and in Periods F and G, 
ratings of Social Relations correlated more highly with ratings of Emotional 
Stability than with ratings of any other variable (Emotional Stability .54; 
Leadership .47). This result is due, in part, to the fact that Social Relations 
and Emotional Stability overlap to some extent by definition. Any manifes- 
tation of anger in a social situation, for example, was likely to result in a 
low mark on both variables. 

In a study of candidates rated 0 or i on Social Relations, not one was 
found to have good emotional adjustment or to be making progress toward 
that state. Although this analysis has several limitations, its findings are at 
least suggestive. But the most convincing indication of the association be- 
tween Social Relations and Emotional Stability, as rated at S, appears in 
Appendix B, (pages 510-515), where a factor analysis of the final ratings 
of variables is reported. One factor derived from the intercorrelations is 
heavily weighted with these two variables. This factor might be termed 
“Adjustability.” 

Of all the variables, the one which seemed to us to require the greatest 
amount of time to assess adequately was that of Social Relations, It was in 
the performance of this task especially that we came to appreciate highly 
the three-day program at S with its myriad situations, both formal and in- 
formal, standardized and free. 


LEADERSHIP 

During the last two periods of S, the leadership of candidates was rated in 
seven procedures. Five of these were situational tests, of which three 
(Brook, Construction, and Assigned Leadership) provided an opportunity 
to observe behavior in field problems, while two (Discussion and Debate) 
were designed to reveal qualities of leadership in an indoor situation and 
in the give-and-take of verbal argument. One of the two remaining pro- 
cedures permitted each candidate’s leadership to be rated by his peers 
(Rating by Associates) and the other yielded a rating by the member of the 
staff who had reason to know him best (Interview). 

There was nothing novel in our conception of leadership. We thought 
of it as a man’s ability to take the initiative in social situations, to plan 
and organize action, and in so doing to evoke cooperation. 

In the beginning we suspected that the man who most strongly asserted 
leadership would not always be able to maintain it and that, conversely, 
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a man who had little drive to assume tlie position of leader might function 
efficiently in that role when placed there by his colleagues. For this reason 
we distinguished, in our early ratings, two kinds of leadership: Leadership 
Assertion and Leadership Efficiency. Yet at the end of Period A, when the 
number of variables to be rated on the Face Sheet of our final report was 
drastically cut, this distinction was given up (in our ratings but not in our 
thinking or in our observations) and in its place a single variable. Leader- 
ship, was substituted. 

Actually, throughout period A, ratings of Leader.ship Assertion and 
Leadership Efficiency had been highly correlated (.86; N= 2 oo), not so 
much, however, because these two forms of behavior could not be dis- 
tinguished but because the only realistic tests employed at this time were 
leaderless group situations in which a man’s efficiency as a leader could not 
be seen or rated unless he asserted himself in competition with others. 
What was needed was a series of group problems in which leadership could 
be assigned to each candidate in succession. It was unfortunate that this 
practice was not adopted until late in the history of S. 

Throughout, it was our intention to discover operational leadership that 
was truly effective. We tried not to be deceived by superficial qualities 
which at first glance look like the real thing — a good appearance, a con- 
fident manner, an impressive voice, and so on. Repeatedly it appeared 
to us that the candidates were much more swayed by such traits than 
we were and that they were e.specially influenced by age and graying hair 
in rating leadership ability. Where such ratings deviated appreciably from 
those given by the staff, we were forced to wonder to what extent the 
factors viewed by us as extrinsic to real leadership operations might not 
in^ reality be intrinsic to it, since leadership must always be in part deter- 
mined by the stimulus value of the leader. Rightly or wrongly, we sought to 
rate the conduct that was shown when active leadership was most needed. 

As with other variables, we constantly had in our minds the question 
of the consistency of the trait of leadership, Is a man’s leadership very 
much the same regardless of the situation in which he is called upon to 
exert rt? Is it reasonable to expect that a man of superior administrative 
leadership will prove himself equally superior when his leadership is tested 
in the field? Can the leadership which a man demonstrates in a group 
discussion of world affairs be taken as a measure of his ability to lead 
men on an operational mission? It was our inability to answer such ques- 
tions as these with assurance that led us to introduce a battery of situa- 
tiona tests, and, beyond that, to seek in the Interview some indication 
not only of the candidate’s leadership in the past but also of the consistency 
and generality with which he had demonstrated this ability. 

Our figures show that the median intercorrelation between tests of Leader- 
ship, .41 (see Table 63, page 521), is higher than such medians for most of the 
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other variables. Leadership rated in one field situation correlated as highly 
with the ratings of Leadership given in Discussion and Debate as it did 
with the rating in another field test. Such a finding suggests thatj as against 
[he other variables rated at S, Leadership is a relatively general trait. At the 
same time, two alternative interpretations of the findings cannot be ignored: 
(i) that the various situational tests, despite obvious differences, were suffi- 
ciently alike to elicit approximately the same behavior from each subject; 
and (2) that in rating Leadership in the various situations the members of 
[he staff were unduly influenced by an over-all halo effect for each subject. 

Of the five situational tests used in the last months at S, three were leader- 
less group situations. Only in Construction and in Assigned Leadership 
problems was the role of leader assigned by the staff. 

From the very beginning of S, the Construction Test was used for the 
purpose of eliciting and rating the leadership ability of candidates but it 
was never a very satisfactory test of this variable, for no matter how much 
expertness a candidate showed he was doomed to fail because the recal- 
citrance of the stooges bore no relation to the techniques employed to elicit 
their cooperation. The behavior of the stooges was designed to frustrate the 
candidates and to the extent to which it did so the situation became more a 
test of emotional stability than of leadership. To be sure, leadership, both 
bad and good, was revealed by candidates in this situation, but there was 
an obvious tendency on the part of the staff to excuse a poor showing here, 
especially if other procedures yielded evidence of a different sort. Although 
Construction provided a sample of behavior which was usually so interest- 
ing and revealing that never once was there any consideration of discarding 
it, nevertheless, it was not one in which ratings were made with confidence, 
nor were these ratings strongly defended in subsequent staff conferences. 
The intertest correlation matrix for Leadership shows that the rating 
in the Construction Test contributed less than any other to the final 
score, 

In order that the final rating of Leadership should not be based solely 
upon estimates derived from leaderless group situations, several tests in 
which the responsibility for leadership was fixed were introduced at vari- 
ous times. One of these was a so-called Recruiting Interview in which a 
candidate interviewed a member of the staff (stooge) to determine his fit- 
ness for an assumed intelligence mission. In this situation the stooge ob- 
served and rated the Leadership of the candidate in so far as it might be 
revealed in his ability to organize the interview, elicit information, develop 
rapport, and inspire confidence in a face-to-face situation. The Recruiting 
Interview was, at best, only incidentally and rather tenuously a test of 
Leadership; it suffered from further defects since it did not involve group 
activity and permitted the variable to be rated by only one staff member, 
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Another test of Leadership, employed for a time, was a Search Problem 
in which oiie man was directed to guide the activities of a group of candi- 
dates in tracking down parts of a message wliich had been hidden in a 
wood, the partial meSsSages being indicated by converging arrows tacked 
on trees. This test appeared to be a reasonably satisfactory one. It was soon 
dropped, however, because of the menace of infected wood ticks, because it 
was expensive in time, and because proper observation by staff members 
was hardly possible. 

Still a third measure of Leadership was tried for a short while in the 
early days of S and then dropped because it bore little relationship to the 
final rating of the variable. The candidate’s ability to plan and organize as 
revealed in a piece of written propaganda that he composed (St. Denis Test) 
was taken as one measure of Leadership. In retrospect it appears that such 
“paper planning” is only a small part of leadership, as we conceived it, 
and that a thoughtful thoroughness in preparing the St, Denis paper prob- 
ably reflected more of an interest in propaganda than an ability for 
organization. The rather introverted, slow-speaking, if not slow-thinking, 
candidates who were dependent upon writing for their most satisfying 
form of self-expression were very apt to be the ones who received high 
ratings oi\ “leadership” in this nonsitualional, nonsocial test. 

Throughout the history of S, the Brook, Discussion, and Debate seemed 
to be reasonably satisfactory leadcrlcss group situations, possessing the virtues 
as well as the weaknesses of all such situational tests, I'hcy revealed those 
who had social initiative and some measure of need to govern others. Also 
the quality of leadership of those who wanted to assert it was exhibited 
as well as the reactions of others to such leaders. But they offered the staff 
no opportunity to estimate the potential leadership of all members of the 
group. Although it seemed likely that the more competent candidates 
usually maneuvered or were maneuvered into positions of leadership, we 
could not be sure of this. Nor unless we observed him acting under these 
conditions, could we be sure whether a man’s leadership would suffer or 
be improved when the responsibility and autliority for direction were given 
him. A willingness and a desire, as well as an ability, to assume leadership 
in an unstructured situation may characterize a truly superior leader but not 
a man of lesser endowment. This, at least, was the rcasSoning that led to 
the introduction of the Assigned Leadership problems. 

There remain two other sources of ratings to be discussed: Ratings by 
Associates and the Interview. The Sociometric Questionnaire, which was 
answered by all candidates on the last morning of their stay at S, contained 
two questions which had specific reference to leadership. The first was: 
Whom would you recommend as supervisor of a group dealing with prob- 
lems of planning and organization? In answering this question, candidates 
were, without doubt, influenced by all the observations they had made of 
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their associates during the period of assessment, but those made the night 
before in the Debate loomed especially large. The recency of that situation, 
plus the fact that it was one of two situational tests in which all members 
of a class were thrown together, inevitably led to an emphasizing of the 
observations made during it when choosing men for a position of adminis- 
trative leadership. The second pertinent sociometric question was: If you 
were a member of a group on a dangerous mission, whom would you 
prefer to have as your leader? In answering this question, candidates tended 
to select team members whose performance they had been able to observe 
in the various situational tests when six men had worked together. There 
is no doubt, however, that observations of the performance of nonteam 
members in the Obstacle Course, the second test in which all members of 
a class were able to observe each other, influenced their selections, since 
physical ability was generally considered crucial for operations in the field 

The final sociomctric rating of each candidate’s Leadership was deter- 
mined by the number of times he was chosen by his classmates for the two 
kinds of leadership. That candidates were inclined to believe that a man 
with administrative leadership tended also to possess field leadership is 
Indicated by a small but interesting study of one hundred cases in Periods 
F and G which revealed a correlation of .71 between selections for the two 
types of leadership. The same study indicated that members of the staff 
weighted the two kinds of sociometric selection about equally in arriving 
at their final rating of Leadership, since rating of associates’ fitness for 
leadership on a dangerous mission correlated .60 and rating of their fitness 
for leadership in planning and organizing correlated .56 with the final rating 
of Leadership. 

The combined rating of Leadership by associates for Periods F and G 
correlated .65 with the final rating. Since the median correlation of ratings 
from all tests with the final rating was .66, it would seem that die judgment 
of a candidate’s associates was neither ignored nor given excessive weight 
by the staff in determining the final grade. 

It was the rating of Leadership given by the interviewer that correlated 
most highly with the final rating (.79). This cannot, however, be interpreted 
to mean that the Interview as an interview contributed most to the final 
rating of the variable. Unfortunately for research, the ratings given by the 
interviewers were based not solely upon information gathered in the Inter- 
view but in part upon impressions gained by observing candidates in many 
situations. Hence it is not surprising that the interviewers’ ratings, often 
given late in the process of assessment, should match the rating finally 
agreed upon in the staff conference more nearly than those of other members 
of the staff. Furthermore, it was the interviewer whose task it was to 
integrate all ratings for his interviewees in the report which he wrote for 
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each of them. It may be said that the interviewer contributed most both 
to final rating.': and to the final rcjiort, but not that the Interview as a 
separate procedure necessarily did so, 

In order to determine, after the fact, what were the characteristics of 
candidates whom wc had rated high in Leadership at the Brook, an analysis 
was made of a series of performances in this situational test. The study 
revealed that of the twenty-five men who had received superior ratings 
of Leadership, only one had received a rating of Intelligence less than high 
average in the same situation. Four times out of five, the personality 
sketches of those candidates who had been rated superior in Leadership 
emphasized energy, zest, effort, or initiative, and never once mentioned a 
lack of these. On the other hand, the sketches of the twenty-five men who 
had received the lowest ratings in Leadership contained no reference to these 
traits. It is clear from these reports that the man who was considered a 
good leader in the Brook situation almost without cxcc[)tion posscsiicd at 
least average intelligence, average physical initiative, more than average 
social initiative, and social relations characterized by tact and good will 
sufficient not only to avoid friction over differences of opinion but also 
adequate to enlist in a positive way the efforts of the less enthusiastic mem- 
bers of a team. 

A wider scanning of the personality sketches of caniiidatc.s who had re- 
ceived either high or low ratings on Leadership revealed a number of 
characteristically associated traits. In the reports on superior leaders frequent 
mention was made of self-confidence, common sense, originality, assertive- 
ness, cheerfulness, tact, persistence, and a desire to excel, Descriptions of 
poor leaders referred often to their readiness for anger, conceit, introversion, 
selfishness, depressive moods, confusion, indecision, excitability, and im- 
pulsiveness. 


TABLE 17 

Correlations between Leadership and Other Variables— Final Ratings 
{Period G; N=/jj) 


Energy and Initiative 72 

Effective Intelligence 65 

Propaganda Skills 51 

Emotional Stability 48 

Motivation for Assignment 44 


Social Relations 44 

Observing and Reporting 32 

Physical Ability 21 

Security 


An indication of the relations which obtained in Period G between 
Leadership and the other variables of personality rated at S is to be found 
in Table 17. It is not surprising to find the strongest relationship between 
Leadership and Energy and Initiative (.72). The relationship may well 
have been enhanced by the fact that the majority of situations at S were so 
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structured that if a man were to exercise leadership in them he had to take 
the initiative. 

The relatively high correlation (.65) between Leadership and Intelligence 
is to be expected, the more so because the intelligence rating was always a 
measure of a man’s practical intelligence, his ability to function effectively 
in lifelike situations rather than his ability specifically to perform in a 
superior manner on intelligence tests. 

At first glance the correlation (.51) between Leadership and Propaganda 
Skills may seem strange, but on second thought it is understandable enough. 
Since two of the situational tests of Leadership (Discussion and Debate) 
involved influencing others to one’s own point of view, a candidate could 
hardly be expected to be outstanding in leadership unless he possessed some- 
what more than average powers of persuasion. Even at the Brook and in 
Assigned Leadership the effective leader had to convince his colleagues 
of the superiority of his plans for action. It is not surprising then that 
Propaganda Skills as well as Effective Intelligence enters significantly into 
Leadership. 

The correlations between Leadership and Emotional Stability (.48), be- 
tween Leadership and Social Relations (.44), and between Leadership and 
Motivation for Assignment (.44) suggest that the effective leader did not 
need to be outstanding in these three other traits, but, on the other hand, 
that he was not apt to be strikingly deficient in them. And this again fits 
well with the impression which the staff had gained in its months of ob- 
serving leaders, good, bad, and indifferent, in the various situational tests. 

The fact that leadership correlated only .21 with Physical Ability but .72 
with Energy and Initiative suggests that leadership, as conceived and rated 
by the staff, involved a fair measure of assertive action but not necessarily 
nor to any important degree physical skill and prowess. In this opinion we 
may have been in error; perhaps we would more often have hit the bull’s- 
eye in rating Leadership as a predictive measure of performance overseas 
had we weighted physical ability more heavily. But the fact remains we 
did not. 

The two correlations still to be noted are of about the magnitude to be 
expected; Leadership with Observing and Reporting (.32), and Leadership 
with Security (.16). 

Most of the procedures which yielded ratings of Leadership also yielded 
ratings of Intelligence and of Social Relations. This fact suggested that we 
might profitably ask the question: In the situations in which the three 
variables were rated, were the ratings of Leadership influenced more by the 
ratings of Intelligence or by the ratings of Social Relations? To answer 
this question a series of partial correlations was run of Leadership as rated 
in the various tests with the final rating, holding constant first Intelligence, 
then Social Relations, and finally both variables. Table 18 shows clearly that 
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the correspondence between the rating c)f Lcatlcrsliip in the tests and the 
final score is lower for every procedure when Edcctivc Intelligence is held 
constant than when Social llclations is ruled out as an influence. Thus 
Ellective Intelligence is again revealed as an important factor in Leadership. 

But this is not to say that any of the paper-and-pcncil test.s of intelligence 
employed by us were as good predictors of the final niting of Lcadc-rship 
as were situational tests. The Vocabulary scores correlated .30 with the 
final rating of Leadership; the Twenty-Minute Otis test correlated only .20. 
Even had these tests been included in the Lcadcr.ship battery it is clear 
that these figures would not have equaled the correlations between situa- 


TABLE 18 

Partial Correlations of Test Leadersliip Grades with I’inal Leadership Grades 

(N = 2r;o to 4^0) 



Final Leatlership 



- 


with 

Partial r, holdifig constant die test grade on 

Tese 

Tesc Leadership 







li (receive 

Social 

Inrclligcncc and 
Social Relations 



Ititelligcncc 

Relations 

Interview 

•79 

•73 

.64 

.68 

■7^ 

•53 

.41 

•56 

•74 

.66 

.68 

Brook 

Discussion 

•45 

Debate 

‘57 

.61 

•31 

Assigned 

•53 

Leadership .... 

.68 

•47" 

‘57 

i 



Intelligence as leaders in Assigned Leadership problem. 


tional racings and final ratings of Leadership. Rather, it was Intelligence 
as rated m the situations that correlated so highly with final ratings of 
Leadership. The ratings of Intelligence and of Leadership made in the same 
vSituation generally correlated in tlie seventies, actually higher than the 
corre ations between Leadership raitags made in difTcrent situations. This 
in ing IS further evidence of the close relationship between Leadership and 
ntelhgence as rated at S. It also indicates that Leadership as rated hy us 
was something else than a completely general trait, which is to say that 
the specific nature of each situational test influenced our ratings appreciably. 

n rating Leadership, no less than in rating other variables, the members 
ot the staff sought to approximate the standard distribution of ratings adopted 
a S, but here again they fell wide of their mark. Distributions of Leader- 
s ip ratings, y test and by final grade, are characterized by extreme posi- 
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live skewness. Table 19 shows this to be especially true of Discussion and 
DebatCj where few stood out as leaders or had an opportunity to do so. 
It is less true of the other situations, where performance of some kind was 
demanded. 

The mean racings of Leadership were, in general, lower than those of 
other variables. Why? For one thing, if a man failed to demonstrate leader- 
ship, the staff was inclined to rale him down to a degree that was not true 
when he failed to manifest some other trait. For example, whereas a man’s 
Social Relations would be looked upon as average until shown to be other- 
wise, failure to show Leadership usually earned a low rating. 

It must be remembered that the distribution of ratings shown in Table 19 
is for the last two periods of S, when the quality of recruits to be assessed 
had definitely dropped in comparison with that of the early assessees, and 


TABLE 19 

Percentage Distributions of Ratings of Leadership in Each Category of the Scale 

{Pa ioJs F~C; 'N=263 to 422) 


Test 

Mean 

0 

0 

I 

2 

3 

4 

5 

Final 

1.8 

10.9 

28.5 

35-5 

20.4 

4-3 

0.4 

Interview 

2.0 

9,0 

25.0 

35'3 

^ 3*5 

6.3 

07 

Brook 

2.0 

12.6 

21.4 

31.0 

23'9 

9.6 

0.5 

Construction 

1.9 

77 

29.3 

35.2 

22.0 

4.8 

o.g 

Discussion 

17 

19.6 

19.5 

33 ’9 

22.3 

44 

0.2 

Debate 

1,8 

16.9 

23.1 

27.6 

25.7 

6.3 

0.4 

Assigned 








Leadership . , . 

2.x 

00 

20.0 

33'8 

29.2 

7.8 

1.4 

Ratings by 








Associates .... 

2.5 

0.7 

21.3 

30.6 

32.0 

9-5 

5-9 


when, by virtue of this unfavorable comparison of our first and last popula- 
tions, the ratings of the later candidates were depressed by the unrecognized 
shift in scale values which had taken place in the minds of the staff mem- 
bers over the months of assessment. Whether a single standard dlsStribution 
of ratings should be held as a model over any long period of assessment is 
an interesting theoretical question raised by these considerations, though 
unfortunately not answered by them. 

OBSERVING AND REPORTING 

The Observing and Reporting battery was intended to measure some of 
the special aptitudes and abilities required of those engaged In the gather- 
ing, processing, and reporting of intelligence in the field. From the begin- 
ning it was understood that Observing and Reporting included five func- 
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tions, and the clillereiu tests tliat composed the battery were designed to 
cover these as well as they could be covered in the time available. The five 
functions were: (i) gathering iiifonnatitjn (observing, interrogating, ells, 
criminating), (2) remembering, (j) evaluating, (4) inferring, and (5) re- 
porting. By necessity, most of the tests involved at least tWf» (jf these functions, 
but for purposes of analysis tlic functions will be ctnisidcrcd separately. 

Gathering Informa tion.-^Threc tyjics of ability involved in the gathering 
of information were measured by several i\t the tests. 

OBSERVING.— Most of thc tCvSts ill the battery called for the ability to observe 
accurately thc qualities and relations of objects, sometimes in thc manner 
of thc military scout, sometimes in thc manner oE thc special investigator 
or detective. The exercises included a tcimninutc search of thc brief case 
of a ‘‘suspicious character” (Brief Case Test); thc observation of the terrain 
and the facilities at Station S over a two-clay peritjd (Terrain Test); a four- 
minute examination of a man^s belongings laid cjut in his room (Belongings 
Test); observation of thc action in two thrcc-miniuc movie sequences 
(Movie Observation Test); and an eight-minute study of a rough military 
map (Map Memory Test). Besides thc ahility to [icrccivc accurately, these 
tests called for the ability to discriminate thc relevant from tl)C irrelevant, 

INTERROGATING,— In onc tcst tlic Candidate had to interview an “applicant" 
for a specialized job and get enough information from him to decide 
whether or not to hire him (Recruiting Test), In uruaher, the candidate 
had the opportunity to cross-examine other candidates and try to break 
down their cover stories (Interrogation Test), The last form of this type 
of procedure required the candidate to interrogate a “soldier** who had 
just escaped from a Japanese internment camp in China and to find out 
all he could about the location of the camp, thc treatment of the prisoners, 
Japanese personnel, incidental intelligence (New Interrogation Test), Suc- 
cess in these exercises called for thc ability to follow a directive, to establish 
rapport, to ask questions that elicit pertinent information, to cover thc 
entire area of requested intelligence, to avoid influencing thc answers by 
rnode of questioning. Interrogation required confidence in a face-to-face 
situation, quick thinking, planning, subtlety of approach, and insight into 
others. 

DISCRIMINATING.-In all the tasks which called for thc discrimination of 
relevant from irrelevant information, some analytical power was required, 
But, in order to measure this function more directly, a special test was 
designed in which the candidates were asked to scrutinize the contents of 
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four documents and extract as many separate items as they could find perti- 
nent to a given problem (SIX-2). 

Remembering.— All tests in the battery involved memory, because in none 
of them was the candidate permitted to take notes. But only in the Terrain 
Test was he expected to remember significant facts for longer than a few 
minutes. Furthermore, since all the questions were of the true-false or 
multiple-choice type (except in the Belongings Test, where questions calling 
for free responses were used), it was recognition rather than recall which 
was tested. Consequently, it seemed advisable to design a technique which 
would measure the power of recall, uncomplicated by differences in the 
ability to observe, and we developed Names and Identifications. 

Evaluating. — The evaluation of information is a further refinement of the 
process of discrimination between relevant and irrelevant material. Besides 
judging the pertinence of each item to the particular aim, it is necessary 
to judge its reliability. Therefore, in the SIX-2 Test, when the candidates 
listed the various scraps of information which they had gleaned from the 
four documents, they were further required to indicate whether each item 
was "probably true,** “possibly true,*’ or “rumor ” The ability to make this 
evaluation successfully depended upon the candidate’s ability to recognize 
to what extent two different reports of the same thing were confirmatory 
or contradictory, his ability to estimate the reliability of each source of 
information, and his ability to judge the value of an item in the context of 
the entire situation described in the documents. 

Inferring. — In some of the tests, the candidates were required to make 
inferences from their observations. In the Belongings Test, they were asked 
to infer the characteristics of the man whose things they had examined. In 
the Terrain Test, in addition to answering the objective questions, they 
had to write a short account of the history of the estate, based on whatever 
inferences they could make from what they had perceived. By and large, 
these and other attempts to test inference ability proved rather unsuccess- 
ful. In actual practice they amounted to little more than indirect methods 
of testing a man’s ability to observe, since, in most cases, the inference 
followed almost automatically from the observation. For example, in the 
Terrain Test, if the candidate saw the sheep pens in the area, the inference 
to be drawn was that the owner of the farm once kept sheep. Those who 
failed to make this inference were not men who lacked the power to infer 
but men who had not observed the pens or men who had little acquaintance 
with farms of this sort. Thus this test measured thoroughness of observation, 
knowledge of farms, and memory of a certain kind. 
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Reporting.-To a large extent, tlic elTectivcncss nf an intelligence operator 
in the field depends on the clarity, completeness, and organization of 'the 
reports he sends back to headquarters. Mis good observations, giKid memory 
careful evaluations, and so forth, can be of no avail if his reports are un- 
intelligible, incomplete, or inaccurate. The SIX-2 Test, which was introduced 
into the battery near the end of the first year of S, was designed to measure 
more directly the ability to report. Having studied the documents and hav- 
ing listed the separate items of information, the candidate was required to 
make a brief written report to headquarters in the form of a radiogram. Here 
it was a question of the ability to condense a large mass of material into a 
brief message which covered the topic completely and succinctly, omitted 
irrelevant details, and was entirely clear. In the New Interrogation Te,st 
intioduccd in the last half of the second year, the c.indidatc was required 
to write a report on the basis of hi.s interview with an escaped pri,soner of 
report afforded additional estimates of the man's reporting 
ability, since the discrepancies between wbat he was able to elicit in the 
interview and what he reported later could be measured, thereby giving 
.some picture of the man’s accuracy, his understanding of the information 
he had gathered, and Ins honesty and integrity in reporting. 

Since most of the tests in the Observing and Reporting battery were 
pcncil-and-papcr tests, objectively scored, it was fairly simple to ,sct uir norms 
tor the conversion of raw scores to the siandard six-point rating .scale. Al- 
t lough efforts were made to keep the conversion tables up to date, the 
c istri ution of scores on the different tests shows, in some cases, more devia- 
tion from the bcll-.shnpcd curve than would ordinarily be expected. Appar- 
ent y fluctuations in raw scores due to changes in population were greater 
than anticipated and occurred faster than the conversion tables were revised. 
As usual, the general tendency was for the frequencies to be excessive in 
the rniddle-score ranges (ratings of 2 and 3). This is particularly true of 
the distributions of the final scores in Observing and Reporting, which 
were arrived at by discussion after averaging the .separate ratings. 

Evaluation of the Procedure, s — During the cour.se of the program, item 
analyses and revisions based on tlic results olitaincd served to improve, as 
later studies showed, the discriminating power of each test. Reliability 
coe cicnts vveie calculated for each of the tests that remained in the battery 
at end of asscs.ment and were susceptible to such treatment. These 
coe icient,s were derived by the application of the odd-even reliability tech- 
nique, using the Pearson r, corrected by the Spearman-Rrown formula. 
^ e lesu ts are presented in Table 20. In general, the level of the coefficients 
i.s satisfactory for this type of test. 

• intercorrelational matrix for Periods F-G presented 

^ ^ ^ 5 ^ 3 ) indicates that the correlations between the sub- 
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tests of the battery and the final scores in Observing and Reporting are, 
as one wcjiilcl expect, of a higher order than the ccjrrchuions between 
ihe siiblcsts themselves. I’hc former range from .47 to .67, while the latter 
range from .13 to .42. Comparison of these data in Table 66 with similar 
data for Period B shows that correlational values derived for the same pairs 
of sLib tests for the dilTercnt periods of the assessment program are of the 
same order, varying not more than .07 points, except in the one case of 

TABLE 20 

Coefficients of Reliability of Tests Remaining in the Observing and 
and Reporting Battery at the End of Assessment, Based on 100 Cases 


Belongings 75 

Terrain 83 

Map Memory 72 

Movie Observation 55 

Names & Identifications 88 


the coefficients expressing the correspondence of scores on the Brief Case 
Test and the Memory Battery (Map Memory Test and Movie Observa- 
tion Test), .09 for Period B and .30 for Period F. The conclusion that can 
be drawn from this finding is that the structure of the battery is sufficienLly 
stable, that is, that the degree of correspondence between the different meas- 
ures employed in the battery does not change appreciably in two separate 
samples of the data. The relatively low correlation between subtests indicates 
that, in so far as they are measuring the ability to observe and report, they 
are measuring diflerent aspects of this ability, which is, of course, one purpose 
of every battery. Furthermore, the relatively higher correlation between the 
sLibtests and the final grade indicates that, in general, the tests are contributing 
positively to the Observing and Reporting rating. The degree of correlation, 
however, is not so high as was desired. 

It is worth noting that the range of correlations between tests and final 
rating in Observing and Reporting is smaller than the range of similar 
correlations in other batteries. One reason for this is that there was a greater 
tendency for the stall to weight certain tests more heavily in other batteries 
than any one test in this battery because here there was less subjective con- 
viction about the relative merits of the individual tests. The scores in Ob- 
serving and Reporting, unlike most of those in the other batteries, were 
derived almost entirely from objective tests, with the result that when it 
came to deciding on a final rating at the conference the staff members had 
nothing to go on except the score on each test and the reputation of the test. 
Here, in other words, perhaps more often than in dealing with any other 
battery in the program, the staff relied on the average of the ratings in 
arriving at the final grade. 
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The relationship of the final score in Observing and Reporting with final 
scores in other batteries is generally of a low order. (Sec Table 58, page 516,) 
The correlation with Ellectivc Intelligence, however, is rather high (.65), 
which is as it should be, since all of the tests in this battery arc measures 
of intellectual ability. As explained in the first part of the section on Effective 
Intelligence, it is convenient, for certain purposes, tcj divide intelligence into 
afferent intelligence and efferent intclligcirce. Afferent intelligence i.s mostly 
concerned with accurate observation, discrimination, analysis, memory, 
jj;if£i‘£nce, diagnosis, conceptualization, and piognosis. Efferent intelligence, 
on the other hand, though it necessarily includes all of these, is more par- 
ticularly concerned with planning ability, long- and short-range strategy 
and tactics, and with using ideas and words in dealing with people and, 
to a slight degree, with using instruments in dealing with inanimate objects. 

It is afferent intelligence, especially, which is required of a student at col- 
lege, of a scientist, and of an intelligence agent; and it is afferent in- 
telligence, chiefly, which is measured by the standard paper-and-pencil 
tests. Of course, there is a large overlap between these two phases of 
the total arc of intelligent action. Knowledge of words, for example, is 
necessary both for understanding written and spoken communication 
and for influencing others. But there is a significant difference, neverthe- 
less, between the kind of intelligence which is generally shown by a scholar 
or scientist and that which is commonly manifested by an administrator, 
politician, or military general. Many of the tests in the Observing and 
Reporting battery, in fact, are more closely related to the traditional con- 
ception of intelligence (as cognition, comprehension, and the like) dian 
are some of the tests included in the Effective Intelligence battery. But wc 
separated the batteries as we did, partly because of the mode of organization 
of the OSS with its specialized secret intelligence branch, and partly because 
the relations of the different mental functions were less clear to us at the 
start of the program. 

A close examination of the scores on the different pacts of the Observing 
and Reporting battery made it possible, in some cases, to discriminate differ- 
ent levels of integration, that is, to distinguish the men who could operate 
best when actively observing and gathering firsthand Information in the 
field from those who were best fitted to analyze, interpret, formulate, and 
orient toward strategy the data gained by others. 

OTHER VARIABLES SYSTEMATICALLY RATED 

Besides the variables already discussed in this chapter, three others ap- 
peared on the Face Sheet of the S Final Report and, for a year or more, 
were rated for every subject: Physical Ability, Security and Propaganda 
Skills. Since these are of less interest generally and were not rated in any 
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of the appraisal procedures that were used to validate our findings, it was 
decided to omit them from this chapter. The various tests and situations 
which yielded scores on tliese three variables have already been described 
in Chapters III and IV, and we surmise that few readers would derive much 
benefit from an examination and discussion of our tables of intercorrelations 
for these variables (see Tables 64, 65, and 67, pages 522 and 524), since these 
particular methods are not likely to be used in other kinds of assessment and 
no general principles are derivable from our findings. 
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assessment at w, ws, and F 


STATION W 

The reasons for which W was originally 
X”ct tora'*o,.a'a.=»«n. pcrW wa> a,ailal.k', ami nm..y can* 

“u”"£ir»ga‘“‘.h”w >“» 

,, sl'n a mni btiafer period its members had .0 make a deemoo .n jh.eh 
they' felt confidence. Biii they did ha«e the atIvantaBe of prior ‘'“"''"h 
and* the fitst W program »as first organiaed as a 
The atatementl made with tcspec. to the cliangotg ^ W 

with eaual force to W. New tests and situations were ckviMil, rctui kc. 
wet Snstilted about their experiences abroad, and regular stall conferences 
were scheduled to facilitate free exchanges of opinion 
technique. Although the daily program was ^ ^ 

burden of work such that there was no opportunity for " 

hour day six-day week, there was a notable feeling of v.eal on the pro 
r st2 Everyone from the secretary to the chief 
to the interest and enthusiasm which charged the atmosphere at W. As 
L case of S, the events of a typical' day at W will give some idea of the 

feeling which characterized the school. 

Since students were not selected for any particular assess n 

remarks made in Chapter 111 wiih regard to recniitment ‘H'P'y ^ ' f 
to the candidates who came to W. It was our cxpcrien« thiU the hr.cK 
given the candidate by the diflerent branch administrative officers in p cp 
Ltion for assessment varied widely. Not only clid the ind.viduffi hr nche 
have their own policies in regard to how much they washed to te I . 
recruit, but the administrative officers within the branch varied in th s 
respect, and efforts to bring about a degree of uniformity were not succe^- 
ful. On the day before he was to report to the assessment school, each canai- 
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longer assessment at S. of course, as revealing highly 

of past achievements, tor respect to the general matter of 

significant traits of personality. But, ^be organiza- 
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status relations when the candidates knew each other's rank, and to con- 
trast this with the greater freedom when rank was not known. As at S 
this procedure did not always make for more accurate assessment. Since it is 
a cold but true fact that rank and status played roles in determining oppor- 
tunity in OSS, enlisted men often were rated high on their potential who 
were bound to be discouraged by their relatively menial assignments. And 
officers frequently were rated comparatively low, although they had, and 
later demonstrated, ample ability to do a superlative job in the task to which 
their rank entitled them. Several such experiences served to remind the sta0 
sharply that its role was that of assessment and not that of social equalizing. 

After changing clothes, the students returned to the office where they 
were given their instructions. They were told that it was important to un- 
derstand these thoroughly, since they would be graded upon their observance 
of the directions. The language of the directions was intentionally some- 
what vague and ambiguous. Some candidates read the sheet quickly, re- 
turned it immediately to the instructor, and went briskly and confidently 
to Room 41 . Others read and reread the material, stood about awkwardly, 
afraid to ask questions, and unable to make any move until prompted, 
Whatever the reaction, it was carefully noted by the observers who, after 
the students left, collated and recorded the data they had secured. 

Instructions 

Your attendance at Station W is for the purpose of evaluating your personal 
assets and liabilities for an assignment with this organization. Because of the 
responsible and confidential nature of the work of OSS, a special attempt is 
made to select and place personnel as wisely and as effectively as possible, not 
only from the standpoint of the greatest efficiency and effectiveness of the or- 
ganization, but also from the standpoint of the individual’s best interests. 

The assessment procedures used at W form a part of this special over-all 
personnel program. You will therefore appreciate the importance, both to the 
organization and to yourself, of cooperating as wholeheartedly as you can in all 
the tasks which you will be asked to carry out. Secondarily, many students have 
found that in the course of the various procedures they have been able to learn 
some useful facts about themselves, even though it is not practical to give out 
the results of individual tests. 

You have been given a “student” name. You should use this and only this 
during your stay at W. Your “student” name may be your own first name, which 
IS ml right. But at no time today should you reveal, either to a member of the 
staff or to a fellow student, what your real last name is. This applies to the 
personal interview and to the Personal History Form as well as to all other 
situations. In conversation with other students you should also refrain from 
talking about your military rank and experience, if any, and the nature of the 
vvork you are doing or expect to do with this organization. In the personal inter- 
view and the Personal History Form you are, however, to give all information 
requested in this connection, fully and accurately. 
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In Room 41 start at once to fill out the Personal History Form. It will be 
necessary to complete this in 60 minutes. Further directions regarding your 
schedule for the day will be given you after you have completed the form. 
Please remain in Room 41 until you receive them. 

Upon reaching Room 41, the candidates found distributed on work tables 
pencils and copies of the same Personal History Form as was used at S. In 
accordance with directions written on the blackboard, each filled out one of 
these forms. 

After one hour, at 9:30 a.m., a member of the junior staff entered the 
room and directed the candidates to stop work on the form, Those who 
needed more than the allotted time to complete the task were given an 
opportunity to do so later in the day, but the schedule for the rest of the 
morning would be tight and the tempo fast. In the next forty-five minutes 
they were required to complete the first page of the P-S Experience Blank; 
the Physical Symptoms Inventory; the Work Conditions Survey; and the 
Progressive Matrices Test, 

Meanwhile, in order to assign the candidates for the Interview, members 
of the staff reviewed the records of the Arrival Situation and considered 
the salient points in the Personal History Forms' which had been filled 
out by the subjects. Those who had given a history of definite psycho- 
neurotic or psychotic episodes or symptoms were always interviewed by the 
psychiatrists of the staff. For the rest, some effort was made to assign candi- 
dates those staff members who had unusual ability to deal with that 
particular type of personality. At best, this was^a rough and not-too-accurate 
procedure, but it was the general feeling that the practice did have some 
value. 

As soon as the students finished the Progressive Matrices, a member of 
the senior staff gave the morning security talk: 

Good morning, ladies and gentlemen. 

When you arrived this morning, you received a page of mimeographed in- 
structions concerning the rules and procedures which you arc to follow here 
today. I want to say a few words by way of emphasizing certain of these rules 
and to give you some additional information. 

First of all there is the matter of individual security. At no time today should 
you do or say anything that will reveal your own last name, It may be that 
your student name is the same as your true first name. That is all right. But 
be careful not to indicate, either to any member of the staff or to a fellow 
student, what your last name is. It may be that some of you have known each 
other prior to coming here today. In that case you will probably know each 
other’s last name. If this is true, be just as careful not to use or reveal another’s 
last name as you arc about your own. Don’t even call anyone you have previously 
known by his true first name if that name differs from his student name. Use 
only his or her student name when addressing or referring to a fellow student. 
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One other point of security. If you are already a member of the OSS, don’t 
discuss your connection or the nature of your work in that organization with 
any fellow student. Remember that he may not be a member of the organization 
and that your talking with him about the organization is therefore a breach of 
security. LikewisCj if you are a member of any of the armed services, remember 
not to discuss your rank or military experience with other students. 

I must warn you that your failure to comply with these security rules will be 
looked upon unfavorably by the staff in assessing you, 

Sometime today each of you will have a personal interview lasting about one 
hour. In that interview the only one of the foregoing security rules which you 
are expected to observe is the one concerning your last name. In the interview 
you are at liberty to speak of your military rank and experience and of your 
connection with and work in OSS if this seems desirable either to you or to the 

interviewer. In a few minutes, Mr. will tell you the time and place at 

which you will have your interview. He will also give you the name of your 
interviewer. 

At the head of the stairs on the second floor there is a Large blackboard. On 
this blackboard you will find posted the schedule for the entire day. Whenever 
you are in doubt as to where you should be or what you should be doing, consult 
this schedule. On or near the blackboard you will also find a clock which you 
can use to time your comings and goings if you do not have a watch with you. 
Try to arrive at tests and interviews promptly, but do not arrive at your inter- 
view ahead of the time scheduled. If you do you arc likely to find the preceding 
interview has not finished. 

I now want to forewarn you about two events this afternoon, About the middle 
of the afternoon, you will come together for a group discussion. The first part 
of your task will be to select some problem which you think this country is 
going to face after the war. It should be a problem which you regard as im- 
portant, one in which you are interested, and one about which you nil have some 
knowledge. After you have selected your problem, you arc to discuss and con* 
sider it with a view to arriving at some conclusion or recommendation as to how 
it should be dealt with. In other words, at the end of the discussion period you 
should be prepared to submit a program of action on which you, as a group, have 
reached some agreement. I mention this assignment to you now so that you can 
be thinking about it in advance and wonk come to the discussion as *‘cold” as 
you otherwise might be if the assignment were sprung on you without notice. 

The other task I want to tell you about is this. At the end of the afternoon, 
you will be asked to take a test of your ability to size up people after only short 
contact with them. Therefore, during the day get to know the names of your 
fellow students, find out something about their backgrounds and interests, and 
try to develop some feeling for the kind of persons they are. It goes without 
saying that you are not supposed to use third-degree methods as a means of 
extracting this information. That might lead to complications if you attempted 
it. However, you are urged to use any of the more acceptable techniques for get- 
ting to know your fellow students and to be able to size them up. 

Lunch will be served in Room 21 at about 12:45 p.m. It will probably be 
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announced by the cook shouting, “Let’s go back.” We have tried to get her to 
say something more intelligible, but we have better success i£ we simply tell 
each class of students in advance what this strange phrase means and let it go 
at that. A few days ago we failed to forewarn a group of students on this score, 
with the following result. They had just finished a test on the fourth floor and 
were all starting downstairs. Just at that moment the cook called Cut, “Let’s go 
back, everybody go back,” whereupon the students dutifully turned around and 
started back upstairs. 

You’re going to be kept pretty busy today, but you will have occasional brief 
breaks when you are free. During these periods we urge you to go to Room 31 
in which you will find a ping-pong table, some cards, a checkerboard, and some 
other small recreational equipment. This is your room and you are encouraged 
to go to it for visiting, rest, and relaxation whenever you are free. 

I am sure it is not necessary to remind you of the special efforts that OSS is 
making to do a good job on personnel selection and placement. This is impor- 
tant not only from the standpoint of the efficient functioning of the organization 
but also from the standpoint of your own happiness and effectiveness in the 
particular job which you may be given in the organization. I am sure, therefore, 
that you will see the logic of cooperating thoroughly and thoughtfully with all 
the assessment procedures. 

As 1 have said, your day here is going to be a busy and strenuous one, However, 
we hope it will also be interesting and perhaps even instructive to you. IE at any 
time you are puzzled about the schedule, the instructions on a test, or anything 
else, please let us know. However, do not take this as an excuse for being in- 
attentive when instructions are being given. The instructions for all tests have 
been worked out with considerable care, and if you do not listen closely to them, 
you may find yourselves rather seriously handicapped in trying to do what is 
asked of you. 

Are there any questions? 

Mr. will now tell you about your interviews. 

Thank you very much. 

At 10:30 half the group reported for their clinical interviews, while the 
others remained behind to take the ACE Test; at 11:30 the groups were 
reversed. 

It should be noted parenthetically that the W standards were quite high 
(see Appendix A-3, pages 505-509). The Matrix and ACE were used at W in 
preference to the Otis since they made some distinction between verbal 
and nonverbal resources, and a majority of the staff felt more secure in 
their judgments when they had this information available. An individual 
Bellevue- Wechslcr was given to those who obviously performed below ca- 
pacity on the group tests. 

Interview.— The account of the Interview given in Chapter III is a com- 
posite of the policies and practices of both the W staff and the S staff. 
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A buffet luncheon was served at 12:30, the candidates and staff eating 
together. The place cards at the table were so arranged that no instructor 
sat with candidates he himself had interviewed, The luncheon situation was 
often highly illuminating. It was the first moment the subjects found for 
relaxing after four hours of constant pressure, and some of them took the 
opportunity to blow off steam. In general, it was the policy to permit the 
candidates to take the initiative in conversation. Many personality traits 
could be evaluated by observing the manner in which they attempted to 
adapt to the social situation. Some were entirely uncommunicative and ill 
at ease. Others found it difficult to talk of anything other than their experi- 
ences of the morning. Some competed constantly for the staff members’ 
attention, snubbing or interrupting their fellows, Some sought reassurance 
directly; others indirectly by talking of their past achievements, by dominat- 
ing the group at the tabic with a continuous display of humor or sarcasm. 
For the sharp observer there was much to be seen which would be of value 
at the preliminary staff meeting which occurred at 1:15 after the students 
went to the Post Exchange Supply Store. At this staff conference, the 
interviewers brought up salient points about the candidates they had seen, 
asked others for the Impressions gained during luncheon, and discussed any 
specific problems they wished to consider further, Thus a student might be 
singled out for extra attention during the afternoon if, for example, the 
interviewer wished confirmation of his impression that the candidate was 
quite unable to subordinate his own desires to the aims uf a group assign- 
ment. In some cases, the man in charge of a situation might even put special 
pressure on the candidate in question by deliberately appointing another 
candidate as leader, or by some other device appropriate to the circum- 
stance which was singled out for attention. 

The situations were run from 1:30 to 3:30 p,m. Small groups rotated 
through the Ball and Spiral, the Bridge or, in the case of women, the Filing 
Test, then they came together for the Group Discussion at 2:45 p.m. 
Before discussing the specific directions for each task, it is appropriate to 
consider the functions of the situations at W. Soon after one-day assessment 
began it became clear that in it situations had less diagnostic power than at S, 
This defect was due to the fact that the schedule at W was so tight, and tlic 
pressure on the candidates so constant, that there was relatively little time 
for the development of any real group spirit among tlicm. They hardly 
had time to adjust to one set of conditions before they were rushed to an- 
other, and throughout there was a natural tendency to regard the day’s task 
as placing a premium on individual achievement. Further, the group pro- 
cedures were limited in scope, and it was far more difficulty to give them 
any manifest validity — even at best there was a certain classroom or parlor- 
game air about them which could be dispelled only with care and effort 
on the part of the staff. However, this is not to imply that the situations 
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were regarded as of minor interest. To be sure, it is theoretically possible 
for the skilled interviewer to find out all he needs to know about a candidate 
by eliciting complete details about a wide variety of real-life situations in 
that candidate’s experience. But no staff member felt that this could be 
accomplished in a sixty-minute interview. Accordingly, the situations were 
looked to for amplification and validation of impressions gained in the 
interview. And in those cases where the two were at variance with each 
other, it was incumbent upon the examiner to reinterview the subject to 
seek an understanding of the traits not hitherto elicited. 

Ball and Spiral.— Designed by Dr. John R, P. French at Harvard as a 
method for studying group structure and attitudes, this task was modified 
for use at W as a stress situation. The test was given in a room equipped 
widi a blackboard, an electric clock with a timed ringing device, and a 
two-way mirror through which staff members in an adjoining room could 
observe the candidates after the completion of the test» The test materials 
themselves consisted of a ball 4 inches in diameter, and a spiral ramp with 
a 3-inch tread mounted on a hexagonal platform to which 6 handles were 
attached. The ramp rose in 4 levels to a 6-inch circular platform, and was 
divided into 25 numbered segments by radial lines extending from the 
circular platform at the top to the points at which each of the 6 handles 
was attached. (See picture facing page 322.) 

The directions were as follows: 

This is a test both of individual physical coordination and of your ability to 
work together as a group. The object of the test is this. You are to roll the ball 
from the bottom of tlie platform up the ramp to the small platform at the top, 
by appropriate manipulation of the board. Each of you is to hold one handle by 
one hand only, but you may change hands at any time. If the ball drops from 
one level to another, that is an error and you must start over from the bottom. 
If the ball merely rolls backward along the ramp, it is not counted as an error, 
and you may reverse its direction by tilting the board. After you get the ball 
to the top, you are to keep it there and set the board on the floor. Since the floor 
is not quite level, it is best to bring the ball to rest against the metal rim on the 
edge of the platform, We will grade your individual performance by assigning 
each of you as goal that segment of the hexagon immediately to the left of the 
handle you are holdingj if the ball falls off in that area it is scored an error 
against you. We will grade your performance as a group by the time it takes you 
to complete the task, assigned. To keep you in touch with the score, we will call 
out each individual error and mark it on the board. To record your progress 
as a group we will place on this graph the number of the segment at which the 
ball drops off the ramp, and connect each mark so as to secure a learning curve. 
You have 15 minutes to complete the test. The bell will ring at 5 minutes, at 10 
minutes, and every minute thereafter until the end. The record for a group of 
6 is slightly under 4 minutes. Are there any questions? All right, go ahead I 
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it was only moderately satisfactory. But despite this handicap, it was con- 
sidered useful in a number of respects, and was used almost consistently 
during the last six months at W. 

The materials for this situation consisted of two raised platforms, 6 feet 
square, i foot high, anchored to the floor 8 feet apart. There were wires, 
ropes, pulleys, and a number of assorted two-by-four boards which had 
holes bored in them and pegs which fitted these holes. None of the boards 
was quite long enough to bridge the gap between the platforms. There were 
also a pail of water and a large box of paper towels weighing perhaps 20 
pounds. 

The directions for the test were as follows: 

This is a simulated field problem, the best we could devise for a building in 
downtown Washington. You are to imagine that you are a scouting party being 
pursued by an enemy force. You have come to a bridge, but find that it has 
been bombed out. All that remains is this debris and the two platforms that con- 
stitute the foundations of the old bridge. These platforms are the distance apart 
at which you see them, namely 8 feet, but we ask you to imagine that the chasm 
between them is actually a thousand feet deep instead of being represented by the 
door as you see it. Now, we will assume that the problem has begun so we had 
better all step over to the platform on this side before we fall to a horrible death. 
Your task is this: the bucket of water on the other side of the chasm represents 
a water-cooled machine gun. You are to bring it over to this side of the chasm 
without spilling a drop. The box on this side is supposed to contain some highly 
secret and valuable radar equipment. You are to transfer it carefully to the other 
platform in such a manner that it will not be unduly jarred or broken. You may 
use only the materials you see about you in effecting these transfers. Remember 
the conditions of the problem. If anything drops into the chasm it is, of course, 
lost, as would be any man who loses his balance. We have increased the artificial- 
ity of the problem to this extent: anything that touches the floor between the plat- 
forms is regarded as lost; if it were a real chasm, you could swing down into and 
over it. And one thing more: make your plans as you would if there were 
actually a chasm a thousand feet deep; do not do anything that you would 
not do if that were the case. You will be marked on your speed and efficiency 
in performing this assignment as a group. When the problem is over, all mem- 
bers are to be standing here on this platform as you are at this moment. You have 
twenty-five minutes to finish the job. Ready? Begin 1 

Although there was something of a boy scout flavor about the problem, 
most candidates went about it vigorously since it was a challenge to what is 
regarded as one of the more masculine of the arts, namely the building of 
structures with a minimum of basic material. In this situation we looked for 
the ability of the students to work together as a group under circumstances 
involving few of the conflicting elements which obtained in the Ball and 
Spiral situation. In that case attention had been purposely directed to in- 
dividual scores; here it was more obvious that participation in group activity 
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was the order of the day. As in all other situationvS, the potentially valuable 
observations which might be made were almost infinite. But we were most 
generally concerned with the following: first, were any of the candidates 
natural leaders— did the others turn to one of the men for suggestions, or 
did each of them scatter and attempt to solve the problem by himself? Did 
the members of the group deliberate and make a plan before they acted? 
Did they try any number of methods, many of which could easily have 
been discarded as inoperable before they even started? Was there a struggle 
for leadership? Who took the lead in finally crossing the chasm (this had 
to be done) to effect the transfer of equipment? And why did he do it? 
Was it to show his superiority, or was he really the logical man because of 
his lighter weight and greater agility? Why did each of the others hold 
back from the trip? Did they fear failure? Were they afraid that falling 
into the chasm would constitute a mark against them, and thus increase 
the possibly bad impression they had made because of a poor score on the 
Ball and Spiral? All the interpersonal events mentioned for the Ball and 
Spiral could and did take place here. Did the members of the group look 
for a plan they thought the instructors wanted them to follow? Some were 
certain the boards were to be pegged together, and spent the whole period 
trying to accomplish this impossible task, while others went ahead with an 
original and highly successful idea without bothering about utilizing the 
great mass of materials available to them. Data of this nature were col- 
lected, and an effort was made to assign numerical marks on the various 
personality variables which have been listed. However, it is obvious that 
the chief value of this situation was to raise questions about personality 
dynamics which required an explanation on the basis of the personality 
trends already explored. If these could not supply a reasonable explanation, 
then new information had to be Sought, new deductions made. 


Filing Test, — Although women could participate in the Bridge Test, it 
was not particularly well suited to feminine interests or special abilities. 
It was consequently found desirable to include in the limited battery of 
performance procedures one test designed expressly for women. For this 
purpose a simple filing test was developed, the instructions for which follow. 

This project is a group enterprise. The problem is to set up a filing system 
using these materials: filing box, cards, card indices, typewriter, letter file, memos, 
and pencils, 

These memos are to be filed and the cards completely Indexed and filled out 
in the simplest manner possible so that the memos can be pulled according to 
the writers and the receivers of the memo. Although there are only ten memos 
to be filed, the system should be set up to accommodate the filing of a large num- 
ber of memos. 

Remember this is a group job and you are working against time, You have a 
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maximum of thirty minutesj but you will be rated according to your speed in 
completing the project. 

Actually the most sensible and<, in the long run^ economical way of 
setting up a file of this kind was to file the memos (in the letter file) accord- 
ing to subject, with two sets of index cards giving sender and receiver in 
alphabetical order. It was, therefore, important to watch for the candidates’ 
recognition of this fact and to listen to the discussion which frequently 
ensued as to whether they should do only what the instructions said or show 
initiative and imagination along the lines indicated. The test provided a 
reasonably good opportunity for making observations on Effective Intel- 
ligence, Social Relations, Leadership, and Energy and Initiative. 

The showing that a candidate made in this situation was naturally influ- 
enced to some extent by past experience with filing systems and by the 
degree of skill which she possessed in the elementary stenographic and 
clerical skills. This fact was not, however, a serious obstacle to the usefulness 
of the test, and indeed made it an especially effective instrument for assessing 
clerical personnel. 

A valuable modification of this procedure introduced late in the program 
was to give the candidates the additional task of assigning each other to as 
many different civil service levels as there were people taking the test, 
these to be based on their contributions to the filing problem. These levels 
were arbitrarily selected by the instructor so as to make it necessary for one 
or two of the students to take a lower rating than they actually might hold 
in real life. Relatively few recognized the fact that this was only an imagin- 
ary situation; they reacted as though they actually were to be assigned to 
these hypothetical jobs. Hence the attitudes and behavior in a competitive 
situation were often clearly delineated. A woman with executive experience, 
for example, would heatedly insist upon a rating of CAF-y even though 
she had made no contribution whatsoever to the filing task. The nature 
of the arguments used and the manner in which they were advanced were 
indicative of what might be expected were the candidate accepted by OSS. 
And this modification of the test was all the more valuable because there 
was a definite tendency in the organization to recruit able and intelligent 
women for relatively simple jobs well below their capacity. While this 
possibility was always pointed out to them in interview, it was frequently 
most illuminating to note the difference between their intellectual and 
emotional reactions to the situation as revealed during the filing test. 

Group Discussion. — If the schedule had been adhered to, the two sub- 
groups of candidates into which the total class had been divided would have 
completed the foregoing group procedures at 2:45 p.m. They then assembled 
in Room 21 and were given these instructions: 
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This morning you were told that there would be a group discussion this after- 
A I- tlioi- rime vou were given some notion as to the nature oE this dis* 
cuSon and were told to be thinking about possible problems. Remember that 
you first task new is to decide upon a problem-some problem whteh you thmk 
dus country will face at the end of the war. This can he either an international 
or a domestic problem, but it should be one that is important, one that interests 

VOU, and one that you all know something about. , . . , , , 

The second part of your assignment, once you have decided upon a problem 
is to discuss and consider it with a view to reaching agreement as to how it 

should, in your estimation, be dealt with. „ . , c 

You will have only 30 minutes for this project Precisely at 3:15 one of you 
should be prepared to make a brief oral report of the groups conclusions and 

^^Now l^me warn you that many groups fail miserably on this procedure for 
two reasons; (i) they fail to organize their efforts, and (2) they allow their dis- 
cussion to degenerate into casual, pointless chatter. Remember that you have a 
definite objective, namely, to present a good final report, and that you have all 

^°°if*any''ot you wish to make notes, you will find scratch paper here on the 
mantel. Please go ahead. 


In certain respects this was the most signiricant and productive of al 
the group proeedures, The social situation was left purpo.sely unstructured 
in order to create maximal opportunity for leadership qualities to come 
out; and no attempt was made to influence the group in selecting any of a 
great number of possible topics. Whereas the earlier procedures called upon 
practical rather than purely intellectual abilities, this situation gave the 
person possessing mainly the latter types of skill his chance to excel. 

Since the whole class was now together and was being observed by most 
of the staff, the social situation was more complex, and jockeying for pres- 
tige and the chance to perform impressively was accentuated. The oppor- 
tunity for the revelation of prejudices and social stereotypes was especially 
good, and emotional tensions often came out clearly. _ 

Of the twenty or so topics commonly selected, the problem of Keeping 
the Peace” and the “Race Problem” were most frequently and heatedly 


QCUllLCU, . 1 . il 1 

At the end of the discussion, a few additional minutes were usual y al- 
lowed for “minority reports" and "dissenting opinions,” but general dis- 
cussion was not reopened. ^ .1 , r 

With so large a group, It was difficult if not impossible for any one 

observer to rate all candidates on all variables. What usually happened was 
that each senior staff member observed and rated his own two or three 
interviewees with unusual care and recorded whatever other ratings he 
felt he could make with reasonable confidence. 
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Sociometric. — This last procedure was designed to discover what impres- 
sions each candidate had made upon the others during the day’s activities. 
As they arrived in Room 41, the candidates were directed to take seats 
around the outer edges of the three long tables which were arranged to 
form a U. On sheets of paper provided for the purpose they were then 
asked to make a rough sketch of this seating arrangement and to write 
down the name of each member of the group at the place on the sketch 
corresponding to where that person was sitting. Inasmuch as each candidate 
wore, in a conspicuous position, a 3'' by 5" card on which his or her name 
was printed, it was usually possible for every candidate, by glancing around 
the tables, to see the names of all other candidates. However, in order to 
avoid any possible difficulty or embarrassment in this connection, the exam- 
iner went around the U calling o£E the name of each candidate in succession, 
When the students had completed their seating places, they were then given 
these instructions: 

Earlier in the day it was announced that this afternoon you would be tested 
on your ability to size up other people on short acquaintance, You were there- 
fore advised to try to get to know something about the background and interests 
of all your fellow students today and to develop some feeling for the kinds of 
persons they are. The ability to size up other people is an important asset under 
any circumstance, but is especially useful in this organization. Today you have 
been associating with a group of individuals under quite unusual conditions. 
Save in exceptional instances, you will not previously have known anything 
whatever about them. Mere you have had little or no opportunity to learn “who 
they are” in the sense of their past accomplishments, social status, family con- 
nections, etc. All you have to go on is “who they are” in the sense of how they 
act and what they can do here and now. The problem is to see how well you 
can reconstruct or infer the real personality and character of other people on the 
basis of this limited kind of information. 

In a moment I am going to give each of you a sheet of paper like this one 
[which examiner displays in his hand], On the upper half of this page are 
seven questions for you to answer. For each question write down the name of 
one and only one fellow student. You may give the name of any one student as 
the answer to more than one question, but you should not, In response to any 
one question, give the name of more than one student. 

In answering these seven questions, consider all the members of the group, 
regardless of whether you have known them prior to coming here today. How- 
ever, for the thumb-nail sketch which you are asked to write in the space given 
on the lower half of the page (and on the reverse side if you need it), you should 
select someone whom you have not previously known, someone whom you have 
met for the first time here today. Be sure also that you put your own student 
name and class number in the places indicated at the top of the sheet. 

Now think carefully ns you answer the seven questions and as you write your 
sketch. We arc not only interested in how well you can size up other students; 
we are also interested in the impressions they have made on you. We take the 



330 


Assessment of Men 


results of this test very seriously; and what you say in it may influence either 
your own assignment or that of other students. 

Incidentally, I should perhaps say that you are not to include staff members 
in this test, however much you may be tempted to. Please restrict your responses 
to your fellow students. 

There is no time limit on this test, and you may begin work as soon as I give 
you your paper. If you have any questions, let me know by holding up your 
hand, but once the test has started there should be no further conversation. 

If you feel at all self-conscious about your answers, you may keep them covered 
with the piece of paper on which you have sketched the seating arrangement. 
When you have finished fold your paper in the middle, crosswise, and I will 
collect it. 

The seven questions constituting the first part of this test arc: 

1. With whom would you most enjoy continuing your acquaintance? 

2. Which member of the group strikes you as the most dogmatic? 

3. Which member of the group would be most likely to make friends 

quickly? 

4. Which person strikes you as the one that people would be most inclined to 

avoid? 

5. Which person was most inconspicuous, i.c., least noticeable? 

6. Which person was most noticeable? 

7. If you were a member of a work group, which one would you prefer to have 

as your leader? 

As might be anticipated, this test, if wrongly administered, can arouse 
a good deal of resistance and antagonism. In keeping down these adverse 
reactions, the advance warning about the test and the use of the seating 
sketch were found particularly helpful. The examiner giving the instructions 
also encouraged wisecracks and questions as the instructions were given 
but then firmly discouraged any tendency to comment or carp after the 
test had actually started. In other words, the aims were (i) to reduce to a 
minimum the realistic frustrations involved in taking the test, (2) to allow 
an opportunity for catharsis of such resentment or embarrassment as un- 
avoidably remained, and (3) to block any further expression of aggression 
or humor which might interfere with the actual taking of the test. 

Indoctrination and Farewell— When all students had finished the Socio- 
metric, a member of the senior staff appeared for the final security talk. 
This usually proceeded as follows: 

You have come to the end of your strenuous day at W. Before you go, I want 
to thank you on behalf of the staff for the cooperation you have shown today, 
and to tell you that we\e enjoyed having you here. I want to add, too, a word 
more about the matter of security. This morning we spoke of the importance 
of individual security, of the care and discretion you should use in concealing 
your identity. [If some students had broken security it was referred to here.] 
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There is another aspect of security that I want to mention now. That is the 
matter of organizational security. I am going to ask your cooperation in not 
speaking of the procedures of the day here at W to anyone, either inside or 
outside the organization. We have three reasons for asking this: in the first 
place, in the light of your own experience, you will appreciate the value in com- 
ing fresh to the day, without advance accounts which destroy the novelty; in 
the second place, we have sometimes found that the student was actually handi- 
capped by the advance warning. The interpretations that are made of the various 
tests during the day are not, we believe, entirely obvious; and sometimes in the 
desire to give a friend a break and let him know what he’s getting into, some 
false interpretation is made which puts him at a disadvantage when he comes. 
In the third place, there is in OSS a special kind of respect for what is “cricket.” 
In this organization, probably more than in any other, it is just taken for granted 
that we can count on your help in keeping the activities of this day at W in that 
category. 

You may remember that in the instructions this morning you read that “many 
students have found tliat in the course of the various procedures they were able 
to learn some useful facts about themselves.” You may have wondered what tliat 
meant. We hope that some of you may have been among the number. You may 
find that in looking back over the day’s activities you’re now able to put to your- 
selves some pretty pointed questions. For example, are the motives which are 
driving you to go overseas clear and strong enough to make you ready to stand 
pressure or danger or boredom or discomfort or frustration or neglect or any of 
the hundreds of possible situations that may arise if you go? Most of us are too 
busy these days to have time to think much about ourselves. Yet during this 
one day you’ve been forced to stop and do it. We hope it has been of some value 
to you, too. 

And now again our thanks, and all good luck in the jobs that lie ahead. 

Exit Interview — After the students had completed the sociometric evalu- 
ations and the men had changed back to their regular clothing, they were 
seen in brief exit interviews by the instructors who had worked with them 
earlier in the day. These interviews gave the students an opportunity to 
ask questions about their reactions to the tests given during the day, and to 
discuss any new problems which might have arisen. In some cases, consider- 
able tension could be released at this time. The exit interview was regarded as 
most helpful in clarifying the purpose of the assessment program. The 
students were able to offer criticisms and suggestions in an informal atmos- 
phere, and it was believed that this procedure enhanced a favorable attitude 
toward the whole experience. Further, the change from the student-instructor 
to the co-worker relationship occasionally brought forth new data concerning 
the personality of a subject. 

The remainder of the period from 4:00 to 5:00 p.xi. was spent in a variety 
of ways. In those instances where it was considered necessary, doubtful 
cases were reinterviewed either by the original interviewer or by a colleague. 
The branch administrators could be consulted via telephone for further 
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information concerning the position for which the sul)ject was a candidate 
—the degree of responsibility witli which he iniglu he entrusted, the social 
and physical requirements he might have to meet, the pOsSsihility oC his 
being called upon to do various tasks, allcrnaiivc positions whicli might 
be open to him, and the like. Not infrequently the administraiivc officer 
would have some information concerning the student’s record which was 
not noted on the Student Information Sheet which had been sent to W 
the day before, and his comments might he of great importance. At this 
time, also, the ratings on the individual personality variables given by the 
situational observers were collected, averaged, and entered on the temporary 
record sheet. These were then weighted by the interviewer, and the final 
ratings for Motivation, Effective Intelligence, Emotional Stability, Social Re- 
lations, and Leadership were recorded. 

Finally, at 5:00 p.m., the entire stafi met in conference. Each candidate 
was presented briefly, the essential facts of the history were given, the 
nature of his proposed assignment was explained, and the findings of the day 
were reviewed. Those on whom there was general agreement were disposed 
of rapidly, but the problems were du^roughly discussed. In diosc cases where 
it was felt that further observation would be necessary before any opinion 
could be offered, it was recommended that the subject be scat to S for 
further study. In all other cases the decision was made and the interviewer 
authorized to write up his report. The form of the report was the same 
as that used by S, although not all the variables were rated at W because 
of the shorter period of observation. Tlie interviewers wrote these reports 
before 10:00 a . m . the following day, turned them in to the chief instructor, 
who reviewed and signed them, and then submitted them to the appropriate 
branch. In all cases of rejection or of approval with qualifications the inter- 
viewer who had seen the candidate called the branch administrative officer 
concerned, and discussed with him the reasons for the staff’s decision, 

STATION WS 

In June, 1944, third OSS assessment unit, WS, wa,s set up in southern 
California in connection, with the newly established West Coast Training 
Center. Station WS served to expedite the screening of personnel recruited 
in the West as well as to prevent the occurrence of a serious bottleneck 
due to overloading at Stations S and W. As predicted, the flow of candi- 
dates was intermittent, and, therefore, in this area it was possible to put 
into effect in some degree the plan of closely observing the behavior of 
students not only during the four-day screening period but also during 
their course at the near-by Training Center, the aims being to make doubly 
certain of their suitability and to evaluate the judgments reached at Sta- 
tion WS, 
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As a rule, instructors at OSS schools were so fully occupied with their 
exacting duties — keeping up with developments in their field, assembling 
materials and teaching aids, preparing projects, lecturing and demonstrating, 
reading examination papers, administering affairs, and so on — that they had 
little opportunity to observe their students except during periods of instruc- 
tion, at which times they were likely to notice and remember only those 
men who were conspicuously capable or conspicuously incapable of per- 
forming the exercises assigned to them. Furthermore, the majority of the 
instructors were either not interested or not skillful in making impartial 
judgments of dispositions and abilities in other people. Consequently, it was 
supposed that not much reliance could be placed on their estimates of per- 
sonality traits in students, either as predictive of future performances or as 
standards against which to measure the accuracy of assessment ratings. And 
so, since it was deemed advisable to continue the process of assessment 
through the training period, the administration adopted the policy of add- 
ing one or two assessors to the staff at the West Coast Training Center, 
It was also arranged to have meetings of assessors and instructors for the 
purpose of arriving at some mutually acceptable definitions of trait names 
(personality variables), so that there would be more justification In the 
future in using instructors’ ratings as measures of the correctness of assessors’ 
ratings. Rut, because of the instructors’ close schedule of obligations and 
the lack of extra assessors during this period, these two plans — the plan 
to continue assessment during the training period, and the plan to evaluate 
ratings made at Station WS — were carried out only to a limited extent. 

Station WS was located at the Capistrano Beach Club, Doheny Park, 
California. The clubhouse with its connecting buildings, standing on the 
beach within two hundred feet of the ocean, was admirably suited to the 
requirements of assessment. As at S, there were ample accommodations 
for the candidates to live and mess with the staff during the period of 
testing. 

There is no necessity of describing the mechanisms of organization: the 
relations of the assessment unit to other units, the manner in which the 
candidates were transported from the holding area to the beach club and 
hack again, the disposition of the final assessment reports, and other details. 
Suffice it to say that the number of assessccs in each group, or '‘class,” varied 
from one to fifteen, most of the groups being composed of about ten men. 
The testing period was approximately four days, 

PROCEDURES 

Station WS was the West Coast equivalent of S, The aims and standards 
set for the two units, the varieties of candidates to be assessed by them, and 
the types of assignments selected for the candidates were alike. Also, the 
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men selected for the WS staff had had several months’ experience at the 
parent institution and were not inclined to modify in any radical way the 
basic structure of the program. Thus practices at the two stations were 
outcomes of a shared policy. 

The physical settings at S and WS, however, were markedly dissimilar. 
Instead of fields and woods, barns and sheds, and, sometimes in the 
winter, snow and icy winds, there were the Pacific Ocean, a broad white 
strip of beach, a superb swimming pool, and a beneficent climate that de- 
servedly enjoys its reputation. To conform to these latter conditions new 
outdoor tasks were improvised and some of the indoor tests current at S 
had to be changed to some extent. And then, as a further determinant of 
some of the differences which will be noted, there was the acceptance by 
both staffs of the policy of repeated experimentation. Constantly readjusted 
by the ingenuity of different men to dissimilar conditions, the WS scheme 
of procedures naturally diverged to an increasing, though never great, 
degree from the forms that were being developed in the East. Finally, in 
its administrations, analyses, and valuations of tests that were essentially 
similar, the WS staff differed somewhat from the staff at S. 

But, despite the interesting novelties that resulted from the operation of 
these several factors, the program at WS does not require detailed con- 
sideration. 

FIRST EVENING 

Immediately upon arrival in the late afternoon the candidates were given 
a welcoming introductory talk to inform them of the rules and purposes 
of the assessment program. They were then issued fatigue clothing and 
settled in their quarters in time for chow at five o’clock. 

At 6:oo P.M. the evening schedule began with a simple questionnaire 
form, followed by the Sentence Completion Test, the Rapid Projection 
Test, and the Thematic Apperception Test. 

Sentence Completion Test.— Same as at Station S. 

Rapid Projection Test— This was a group, multiple-choice test of the 
Thematic Apperception Test variety that was tried out for several months, 
but since no definite evidence of its efficacy was obtained, no purpose can 
be served by describing it. 

Thematic Apperception Test. — This was presented to the whole group 
as a written assignment. The directions were as follows: 

This is a test of imagination, one form of intelligence. I am going to throw 
some stercopticon slides on the screen one at a time; and your task will be to make 
up as dramatic a story as you can for each slide. Tell what has led up to the event 
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shown in the picture, describe what is happening at the moment, what the 
characters are feeling and thinking, and then give the outcome. You will have 
ten minutes for each picture, so you will have to write quickly. The average 
length of stories we have been getting is about a page and a half. I’ll tell you 
when eight minutes are up. Are there any questions? Here is your first picture. 

The following pictures (from the Harvard University Press series) were 
shown : 

1. Picture 6BM. A short elderly woman stands with her back turned to a 
tall young man. The latter is looking downward with a perplexed expression. 

2. Picture 12M. A young man is lying on a couch with his eyes closed. Lean- 
ing over him is the gaunt form of an elderly man, his hand stretched out above 
the face of the reclining figure. 

3. Picture 18BM. A man is clutched from behind by three hands, The figures 
of his assailants are invisible. 

4. Picture 10. A young woman’s (?) head against a man’s shoulder. 

5. Picture 4. A woman is clutching the shoulders of a man whose face and 
body are averted as if he were trying to pull away from her. In the background 
is the figure of a seminude woman. 

6. Picture r6. Blank Screen. 

The rationale of the TAT is discussed much more comprehensively in the 
test manual than can be done here. Suffice it to say that it is a projective 
technique that makes use of the tendency of people to interpret ambiguous 
human situations in conformity with their own experiences and wants, and 
the tendency of those who write stories to do likewise. 

At first it was felt that the greater the number of pictures the more 
productive the test, and hence ten pictures comprised the original set as 
administered at WS. But it was soon discovered that when the number of 
stories asked for in a single evening was more than six, the candidates 
would complain of writer’s cramps, general weariness, and eyestrain in 
the dimly lit room. An hour of continuous imagining and writing appeared 
to be the outside limit. Continuing the test longer than this provoked 
resentment. 

Interpretation is the major obstacle in the inclusion of this test in a brief 
assessment program, especially where the staff is limited. Each set of TAT 
stories requires from thirty minutes to an hour merely for a rather quick 
over-all evaluation. The interpreter must feel his way into the atmosphere 
of the stories, and even granting talent and experience, this process takes 
time and concentrated absorption. 

No systematic scoring of the responses was attempted, but it was not long 
before a relatively inexperienced interpreter with sufficient talent could dis- 
criminate the stories that were high or low in aggression, passivity, domi- 
nance, and so forth, or before he could “feel” the relative dejection or 
exaltation pervading them. Perhaps more useful for the purpose of a quick 
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personality sketch was the evaluation of each set of stories as a unit. Here 
it is a matter of asking; What issues, conflicts, or dilemmas are of major 
concern to the author? With what needs and press, ideas, attitudes, and 
aspirations docs the author seem to be chiefly involved? 

The staff member charged with the scoring of these six stories tried noth- 
ing more ambitious than writing up these high-low needs and press, 
summing up the chief situations and plots in the stories, and pointing out 
the features which were strikingly unique. 

The chief value of this test in the program at WS was to provide the 
interviewer with fruitful hypotheses and promising lines of approach in 
exploring each candidate’s personality. 

FIRST DAY 

The candidates spent the first three hours of the morning in taking a 
series of intelligence tests and writing an autobiography. The Discussion 
came at n:oo 

Individual and Group Psychometrics — The customary schedule in- 
cluded two sessions for the group administration of tests belonging to this 
category. At the first session, held on the morning of the first full day of 
assessment, the Progressive Matrices, Series Com[decion, Mechanical Com- 
prehension, and Vocabulary were presented, followed by the Personal 
History Form. At the second session, on the next day, the Memory for 
Design and the Memory for Map and Instructions were given. Ultimately it 
became standard procedure to administer the Wechsler-Bcllcvuc or the Army 
Wechsler to every candidate individually. Thus because of a smaller flow 
of assessees at WS, it was possible to measure a little more thoroughly 
than it was possible at S each candidate’s ability to perform the mental 
operations called for in these tests. 

Discussion — Same as at Station S. 

After lunch the candidates were given their medical examination, the 
Railroad Bridge, the Recruiting Interview, and the Briefcase. 

Railroad Bridge.— This was an individual field task which called for 
observational ability, resourcefulness, and ingenuity. 

The problem was to remove a box of “explosives” weighing 300 pounds 
from a point on one side of an “electrified” barbed wire fence to a railroad 
bridge on the other side of the fence, without coming into contact with the 
fence. The candidate was allowed to use such equipment (e.g., wheel- 
barrow, planks, rollers, block and tackle) as could be found scattered around 
the area. 
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The perfect solution involved the removal of the box of explosives away 
from the fence to the mouth of a culvert near the beach, lowering the box 
into the culvert, and then pushing the box through the culvert (underneath 
the fence) to the bridge* The particular difhculty of the problem derived 
from the fact that the box of ammunition had first to be transported awa*^ 
from the bridge in order eventually to get it to the bridge. 

Recruiting Interview. — Some assignments proposed for OSS candidates 
called for recruiting ability. This was taken to include the ability to arouse 
the interest of supposedly qualified persons, to estimate their usefulness, and 
10 persuade them, if judged suitable, to accept membership in a given 
organization. The Recruiting Interview was designed as an aid in estimating 
these capacities. 

Each candidate was instructed to assume that his job was to recruit 
personnel for G2 work in Spain. A civilian who had been referred to him 
by a mutual friend without recommendation was about to apply for a 
position. After the interview, which would last fifteen minutes, the candi- 
date would be expected to prepare a detailed report of the applicant’s quali- 
fications, to rate him on mental ability, tact in dealing with others, depend- 
ability, and motivation, and to slate whether or not he would hire him and 
why. 

The “applicant*^ was a staff member, carefully schooled for this test, 
who acted in accordance with an invented life history and personality pat- 
tern. At the conclusion of the interview the applicant rated the candidate on 
Effective Intelligence (skill in questioning, ability to note inconsistencies, 
and the significance of information which the candidate had elicited) ; Social 
Relations (degree of rapport which the candidate established, his social 
awareness, tact, and absence of annoying traits); Leadership (planned use 
of time which the candidate had made, his ability to persuade, and his 
ability to create confidence); and finally Security (the care with which the 
candidate guarded not only his personal identity but the nature of the or- 
ganization and the prospective assignment for which the applicant was 
being interviewed), 

Briefcase.— The Briefcase Test of observing and reporting was similar 
to the one used in the early months at S but the materials were different; 
a manila expanding file with some twenty sections containing a variety of 
papers, pictures, souvenirs, and other odds and ends, thirty in all, pertinent 
to the identification of the owner of the case, his employer, his home, his 
acquaintances, places he had visited, and so forth. This situation called 
for the rapid and acute scrutiny of a number of clues from which certain 
inferences had to be drawn. In some cases the indications of two or more 
items had to be connected in order to arrive at the proper conclusion. The 



338 


Assessment of Men 


test was administered to the candidates individually at intervals of ten 
minutes. The details of the procedure are sufficiently revealed in the instruc- 
tions: 

In this room you will find a manila filing case which belongs to a person 
who was formerly visiting this area, and whose identity is unknown to you. You 
are given the task of examining the contents of this filing case with the purpose 
of discovering as much information about this unknown person as possible, 
You are allowed ten minutes in which to make your examination, and during 
that time you may make whatever notes you feel are necessary. After nine min- 
utes have elapsed, you will be warned that there is but one minute remaining 
in your examination period, so that at die end of the ten minutes you will have 
replaced all the material and be ready to leave the room. When you have com- 
pleted the examination you will be asked to write your conclusions about this 
unknown person. This account may take any form that you wish, the essential 
thing being that you give me as much information as possible. After this report 
has been written you will be given a number of questions concerning this 
individual, and it may be diat you will have answered many of them in your 
report, However, you will be asked to indicate these answers again. If there arc 
no questions, you may go in. 

The schedule for the rest of the afternoon and evening was as folio w^s: 

3:30 Committee Report 

4:30 Physical Ability 

6:00 Propaganda Recognition, followed by Cable Report 

7:30 Flashlight and Belongings 

Committee Report. — This test was essentially a structured group discus- 
sion and differed from the latter in that the candidates were required to 
choose a chairman and an opportunity was afforded to observe their ability 
to abstract written material and present an oral report of it. Also, since 
the topic of the discussion was propaganda, it was easier to single out 
the candidate who was “propaganda wise’’ than it was in the Discussion. 

The candidates were asked to assume that they were members of a com- 
mittee assigned to advise on the kind of propaganda to be channeled through 
French Indo-China. They were given a file of information on the region and 
told that they had fifty-five minutes in which to prepare a list of propaganda 
suggestions derived from that file. The task required that each man read 
one of the memoranda and make an oral abstract to the group, and then, 
that all of them working together, integrate the information and decide 
on a number of effective lines of action. Leadership, Propaganda Skill, 
Observing and Reporting, and Social Relations were rated. 

Physical Ability — ^Physical Ability was tested in five athletic events: swim- 
ming under water for distance, swimming for speed any style, broad and 
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high jumps, and the fifty-yard dash. The three track events were performed 
on a sandy beach which made running and jumping much harder, and 
increased the importance of sheer strength, relative to agility, as a deter- 
minant of success. Other land and water situations were occasionally 
employed. 


Propaganda Recognition — This test was designed as a measure of a 
person’s ability to evaluate propaganda devices. Part I consisted of twenty 
pairs of slogans, the candidate being asked to check which one of each 
pair was likely to be more effective in influencing the general public. Part 
II consisted of eight pairs of proposed poll questions, In each instance the 
candidate was told to assume that he was a propagandist interested in con- 
vincing others of the wide currency of a certain specified opinion and 
then, with this aim in mind, to check which one of the pair of questions 
was likely to draw forth more answers of the sort that he desired. In addi- 
tion he was asked to give his reasons for each choice. 

In devising the slogans for Part I of this test, the following procedure 
was followed: a list of propaganda techniques was drawn up such as “card- 
stacking” (e.g., “He has won all his races,” instead of “He has won the 
two races in which he has taken part”); “name-calling” (e.g., “govern- 
ment waste” Instead of “government expenditures”) ; and so forth. Then a 
number of slogans exemplifying these techniques were selected and paired 
with plain factual statements. In each case, the propagandistic slogan was 
tentatively assumed to be the “correct” (more elective) one. 

In devising the items for Part 11 recourse was had to several studies made 
by the American Institute of Public Opinion (Gallup Poll). In order to 
shed light on the technique of constructing poll questions, Gallup had 
sampled cross sections of the population on various matters, using differently 
phrased questions. He found, in conformity with his prediction, that the 
wording of the question would sometimes influence the answers obtained. 
For instance, to the question, “Should the United States increase our Army 
further, even if it means more taxes?” 88 per cent of the people replied, 
“Yes.” But when the question was changed to, “Should the United States 
increase our Army further, even if you have to pay more taxes?” only 79 
per cent of the people replied, “Yes.” Personalizing the payment of taxes, 
apparently, decreased the number of citizens who favored enlargement of 
our Army. 

Since this test was devised shortly before the closing of Station WS and 
was administered to only a few candidates, an evaluation of the technique 
is not possible at present. 


Cable Report. — This procedure, like the SIX-2 test at S, was designed 
to measure a candidate’s ability to assemble, analyze, and evaluate the sub- 
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stance of written material and to summarize concisely and correctly the in- 
formation thus obtained. 

The test was given to the group as a written assignment. First the mimeo- 
graphed sheets (Reports Received at Message Center) were distributed, the 
candidates being instructed to read them carefully. The following direc- 
tions were then read: 

You arc in Bassein, Burma, charged with the responsibility of collecting 
collating, and transmitting to the Intelligence Officer of this organization infot’ 
mation brought to you in brief written messages from various military observers 
in Burma. The sheets in front of you represent ten such messages. You are to 
sift out the information in these messages, determining what is fact and what 
is rumor, what is essential and what is irrelevant. You are to t.ake for granted 
that anything stated by the observer as a firsthand report (c.g., "I saw the battle- 
ship^ launched,” or “the general passed through here,”) is a fact; but that if 
the information is modified in some form (e.g., “I have heard that . . .” or "It 

is reported that . . .’ ) it must be considered a rumor, unless there are other 
confirmatory data, 

Frorn the point of view of the Intelligence Officer of this organization, material 
pertaining to the civil and political affairs of Burma is of equal significance with 
the strictly military. It need not, of course, be emphasized that the more precise 
and specific the information is, the greater its value and usefulness. Tims it is 
more valuable by far to say that the 12th Division, for example, passed through 
Bassein than to say only that a division passed. And, of course, rumor may be as 
vaffiable as fact for intelligence purposes, but it must be labeled clearly as such. 

Your job IS to write a radiogram (c,ablcgram) of no more than 40 words 
transmitting all the essential information contained in these ten messages. You 
have thirty minutes for this task. 


Reports Received at Message Center 


— I" 


information that all carriers attached to the Third 
Naval Task Force just arrived at Rangoon were sunk in last action. 




^^Sccret launching of the new super 45,000 ton battleship huge success is report 
unk'novra^'^'' Infantry Division based in .Siam passed through here. Destination 

— 3 — 

Underground activity in Bassein district satisfactory, but there is dangerous 
leak of information somewhere along line at Chungking or Calcutta, probably 

u ^tittermaster warehouses 

quantities. Concentrated 

mainly along nver front. Do not know for what theater it is intended. 
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“ 4 — 

la whole of Burma, as well as In iiiiportant Irrawaddy delta area, there re- 
mains prewar distrust of Britain, making propaganda piped from India com- 
paratively ineffective, if not actually harmful. 

Report current here that four carriers of the Third Naval Task Force sunk. 

•“ 5 “" 

There is much talk that the new 45,000 ton battleship capsized when it was 
launched yesterday. 

A news story carrying a Tokyo dateline reports that both carriers oE the Third 
Naval Force are safe in an uninentioned Japanese base. The fleet, said the story, 
did not sustain losses of any consequence. 


Have had some indication that one of our men in Calcutta or Bombay is un- 
reliable. Chungking man all right, News and instructions piped from China of 
increasing effectiveness in underground and with population. There is feeling 
there that fate of Burma allied to that of Chinese. Three infantry divisions for- 
merly based in Siam on move to combat duty. Theater of operations unknown. 

Memorial services held in Tokyo yesterday, according to Japanese news broad- 
cast, for those of Third Naval Force lost at sea. The General Staff was present. 
Losses must have been considerable. 


The Ninth and Seventieth infantry divisions have been ordered out of Siam 
to an active theater of operations. Guess is that they are on way to China. 

— 8 - 

Spoke to a group of sailors at Rangoon. Said that they had been through 
strangest naval engagement in experience. After two days’ battle only losses 
sustained were both carriers. No destroyers, no cruisers, no tenders. Just die 
two carriers. Spoke to several sailors who had been aboard the two and 
rescued. Said both ships were torpedo-bombed. Losses in personnel were con- 
siderable; including both commanders. Support on western delta of Irrawaddy. 
May be Wellington, Bassein, or Myatani. 

— 9 — 

Preparations are being made in Manila for receiving three new infantry divi- 
sions. It is said troops arc cn route from China, Slam, and Burma, 

—10— 

Report that only several destroyers and one light cruiser of the Third 
Task Force were damaged or sunk, but that both carriers are safe in unmen- 
tioned base is front-page story in Rangoon papers. This is to deny widespread 
rumors that the two carriers attached to the fleet, the Yoshima and Tulagi, had 
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been sunk. Two sailors were court-martialed for telling the slory of the recent 
battle. There is intensive campaign to "button your lip." 

I have received unconfirmed information that Gan Boon, Calcutta observer 
is on Jap pay roll. Bombay man above suspicion. 

The following is a list of the acceptable answers with the raw score for 
each correct item: 


Item 

Calcutta man unreliable 
Distrust of British high 
Chinese propaganda effective 
Third Naval Force in Rangoon 
Two Carriers lost 1 
Tulagi, Yoshima J ® 

Three divisions move from Siam j 

5th, 9th, 70th Divisions on move i a 

Manila preparing to receive three divisions J 
Bassein new quartermaster base 1 
For India theater | ^ 


Credit 

1 

1 

I 

I 



The items bracketed were given credit according to the preciseness of the information 
transmitted. To specify ‘‘'‘lulagi and Yoshima lost" was wortli full credit; to say merely 
"Carriers lost” p2 credit. 


The inclusion of erroneous Information was penalized rather heavily, one 
half credit or a full credit being deducted, depending on tlie gravity of 
the misinformation. The “lyth” Division instead of “yoth" (a not uncom- 
mon transposition), for example, was penalized ^ credit; to say that the 
Bombay man was on Jap pay roll cost the writer a full credit. To transmit 
a fact as a rumor or a rumor as a fact was to lose credit for it. Irrelevant 
information (such as “memorial services held in Tokyo yesterday”) was not 
scored at all, since the writer had already been penalized by using up some 
of the 40 words permissible on data which yielded no credits. 

That there was a need for a verbal observing and reporting test in the 
assessment program was undeniable. That such a test might well have taken 
the form of this one is not unreasonable, but that this was the ideal test 
was questionable. It was, for one thing, a little loo short, the amount of 
information required to obtain a score of 2 was only slightly more than 
the amount required to get a score of ij 4 . Also, the a priori decision 
as to what was essential and what irrelevant may not hold up under more 
caieful analysis. On the other hand, the test did .seem to provide some 
measure of observing and reporting, since there was a good spread of scores 
and a positive (.p) correlation between this test and the final over-all 
rating on this variable. Furthermore, it was noted that those who had had 
experience in this field of activity did well, almost never being penalized 
for wrong information, and those who were untutored in collating writ- 
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ten information tended to fall below the mean by being penalized rather 
heavily for transmitting misleading data. 

Flashlight,— The Flashlight Test of observing and reporting was similar 
to one that had been used for some months at Station S, but at WS this 
test was combined with the Belongings Test, the same materials being 
utilized in both. The procedure required two sessions. 

The candidate was shown into a dark room in which there were thirty- 
three objects which he had five minutes to examine by the aid of a flash- 
light. He was told that he would be asked to identify the objects at a later 
time. On the following morning he reported for the second part of the 
test. In the meanwhile, the staff member in charge of the test had rearranged 
the objects in the room and had added a number of items which were 
very similar but not identical to those present at the time of the first ex- 
amination. The following instructions were read : 

All of the items which were in the room when you made your examination 
last night are still here, The objects have been moved about and many things 
have been added, Now you may look around the room and point out the objects 
which were here last night. I am interested only in the fact that they were present, 
not in their position, nor am I interested in the objects which were not present. 

Belongings,— The Belongings Test for observing and reporting was similar 
to the one used at S except that the materials were different and at WS it 
was administered simultaneously with the first part of the Flashlight Test, 
one assemblage of items forming the basis for both tests. 

SECOND DAY 

Most of the morning was devoted first to group intelligence tests and 
then in rotation to individual intelligence tests, the Editorial Test, and the 
Interview. The intelligence tests have already been described. 

Editorial Test,— The form of this test was that of a conversation directed 
in such a way as to provide some basis for ratings on Observing and 
Reporting, Social Relations, and Effective Intelligence. An editorial was dis- 
tributed to the candidates with instructions to read it' carefully so that 
they would be able, on the next day, to give a summary of its contents, 
(The editorial was a polemic in defense of war.) 

When the candidate came to present his summary, the examiner started 
the conversation by inquiring in an informal manner what he thought 
of the ideas expressed in the editorial. In the discussion which followed, the 
candidate was forced to defend his position, the staff member always taking 
the opposite view. 
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The data for Observing and Reporting were obtained from the candidate’s 
oral summary of the editorial. Was hi.s memory of the facts precise.? Had he 
selected the major points? Did he present his report clearly and concisely? 

In rating Social Relations, the candidate’s face-to-face behavior with the 
examiner was noted. Was the candidate at case? Did he talk without 
halting and without embarra,ssment? Wa.s he too argumentative or too sub- 
missive? Did he interrupt frequently? 

Effective Intelligence was determined by the student’s general handling 
of the problem. How quickly could he mu.ster arguments? Of what caliber 
were his ideas? How articulate and accurate was he? 

In ending the test, the interviewer brought the conversation back to a 
more personal plane by saying something in this vein: "Well, this has been 
very interesting. I wish there were time to continue, How are you enjoying 
your stay here?’’ To this question the student frequently responded by 
launching into an account of his reactions to one or another part of the 
assessment program. 


Interview.— The interviewers at WS carried out this key procedure in 
much the way it was done at S and W, but they conceived it as being 
m ed into three overlapping phases; the opening phase, the middle 
phase, and the end phase, and of these three they put more emphasis 
on the last than did the interviewer at the other assessment areas. In sum- 
mary, these three phases were as follows; The opening one, by far most 
crucial, devoted to developing positive transference, a friendly, warm, and 
confident attitude of the candidate toward the interviewer, with freedom 
trom_ the usual interpersonal inhibitions. The second, given over to the 
building up by the interviewer of a concept of the student’s personality 
components._ Preliminary hypotheses were continuously abandoned, read- 
tL' ‘I coherent dynamic pattern began to be apparent. 

third phase began when the interviewer became confident that his 
concepts were reasonably correct and that they hung together. Then he had 
two tnajor o jectives: to arouse in the candidate recognition of the correct- 
ness of his hypotheses; and to restore the candidate’s composure with psycho- 
therapeutic reassurances and explanations when indicated. It was not neces- 
.sary to tell a student whether he had passed or failed, hut at least it was 
imoreLtf R tinder, stand why lie had left a particular 

Z m W T interviewer’s obliga- 

_ n to obtain the candidate’s permission for him to have the personalfty 

impression that he had when the interview was finished. The student was 

othcrZiM ?n tff unjustly evaluated, for there was no 

p. n the^ program where such resentment could be removed, 
c in erviewer s c oice of statements, his interpretations, and his inflec- 

TandlSZc‘ ''^.^^“^ng the pattern for the staff’s reaction to 

idate. Conversely, the interviewer’s judgment could he radically in- 
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fluenced by current observations and comments by the staff, and again it 
was his duty to fit such evidence correctly into a coherent conception. The 
Interview, then, was not just the hour spent with the candidate. That period 
provided a certain body of information and an empathic feeling about 
the candidate, but many casual contacts and conversations with both can- 
didates and staff allowed for an expansion and elaboration of these initial 
concepts. Only at the close of the assessment period, however, was the Inter- 
view considered to be at an end. 

The schedule for the afternoon of the second day included, in addition 
to interviews and individual intelligence tests, the Bridge, the Burma Town, 
and the Propaganda Leaflet project. 

Bridge — This group task, modeled after the Brook at S, required that a 
loaded wheelbarrow be moved across a “river.” The undertaking called 
for cooperative activity and provided data for ratings on Effective Intelli- 
gence, Leadership, Social Relations, and Motivation. 

Burma Town,— A relief map of a Burma town presented the candidates 
with a novel situation in which their ingenuity, ability to meet unexpected 
situations, their leadership, and their social relations could be observed. 

The members of the group were given the following instructions: 

You are to assume that all of you are in an airplane flying over this terrain. 
You are on your way to a secret mission. None of you knows where you are 
going except tlie pilot. You know nothing about the terrain over which you 
are now flying except that it is some place in Burma. You are all dressed in the 
uniform of American Army officers of equal rank.. 

You are flying in this direction [pointing toward the mountains on the relief 
map]. When the plane reaches a point directly over the town, the plane develops 
motor trouble. The pilot attempts an emergency landing but crashes into the 
mountain at this point [indicating the point] and the plane is wrecked and the 
pilot killed. One of you suffers a broken leg, and the rest get out of the plane 
uninjured. 

You are to assume that you have just stepped out of the crashed plane. What 
do you do? I want you to plan your procedure as specifically as you can. Decide 
who is the injured man, what you do first, why, you plan as you do, and so 
forth. 

During the ensuing discussion, notes were made on who took the initiative 
in making suggestions, who had the best suggestions, what frictions arose 
when cbntradictory plans were suggested, who was the accepted leader, and 
the like. 

Propaganda Leaflet. — Like the Manchuria Project at S, this test was de- 
signed to give a measure of one variable — Propaganda Skills. It did this 
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by pressing the candidate to display whatever ability he had to analyze in- 
formation about a population which must be influenced, to organize per- 
suasive devices, and to write copy. It was, in short, a propaganda test; 
but since this was the only extended piece of work— at least four hours in 
duration— during the assessment period which was left entirely to the 
candidate’s own responsibility so far as the time to be devoted to it was 
concerned, its value as an indicator of motivation, diligence, and work habits 
should not be overlooked. 

The material for the test consisted of a Report on Eassein and an Assign- 
ment Sheet. These were distributed to the members of the group at six 
o’clock on the third evening (second day) of their stay at WS, with the 
remark, "This is a rather big job, but you have until six o’clock tomorrow 
evening to complete it.’’ By this time, all of the group situations and most 
of the individual tests had been completed. Some of the candidates felt 
that they had, to use their own words, “taken a beating.’’ And some felt 
that much of what they had done had been “unreal.” They had been asked 
questions to which they did not know the answers, and they knew the 
answers to questions they had not been asked; they had played with blocks 
and built bridges over waterless rivers; they had put mannequins together 
and pulled Gestalt figures apart. 

Against such a background it was not difficult to make the propaganda 
test real and vital. A stalf member, pointing to Bassein on the map of 
Burma, read the following instructions; 

You have been given the responsibility of organizing, introducing, and carry- 
ing through a propaganda campaign in Bassein, Burma. All the information you 
have is in the attached report. Your long-range purposes arc threefold; (i) breed 
hostility to the Japanese among the natives; (ii) make popular the cause of the 
Allies; and (iii) reduce the level of morale among the Japanese troops stationed 
in Bassein. 

The candidates were requested to read the assignment sheet by themselves 
and then to ask any questions that occurred to them. Before leaving, the 
stafi member informed them that they had the entire evening and at least 
two or three hours of the next day in which to complete the assignment. 

THIRD DAY 

The third morning began with the Dugout, an outdoor group project 
(8:oo A.M.). This was followed by another round of interviews and indi- 
vidual intelligence tests. 

Dugout. — ^In addition to eliciting data on. Leadership and Effective Intelli- 
gence, this task afforded an opportunity to observe Social Relations under 
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conditions of rivalry. The candidates were taken to the beach, divided into 
two competing groups, and then told that each group was to construct 
a strategically situated and well-camouflaged dugout capable of holding 
three men. 

The area afforded many different locations for the dugout, each with 
advantages and disadvantages. The first task was to c!ioose and secure the 
best location ahead of the rival group. As building materials, for which the 
groups had to compete, all sorts of debris, boards, and boxes were scattered 
on the beach. 

When the dugouts were completed, each group was asked to criticize 
the other group’s work. During this phase the examiners directed their 
attention to the following points: Was the candidate more critical of the 
work of others than of his own? Was his criticism tactfully given? Did 
he take criticism well? Did he have a sense of humor about it all? 

The criteria for Effective Intelligence and Leadership included such mat- 
ters as choice of location, use made of debris as material, ingenuity of 
camouflage, efficiency of planning, success of attempts to direct operations, 
and so forth. 

In the afternoon of the third day, the candidates were given some free 
time in which to complete the Propaganda Leaflet. On the schedule there 
was the frustrating Coat Hanger situation, and in the evening occurred the 
Stress and Post-Stress Interviews. 

Coat Hanger — This test provided an opportunity to observe a candidate 
work under adverse circumstances and to note his reactions to criticism. 

The test was administered in a small, boothlike entry (to a locker room), 
the dimensions of which barely permitted an adult to turn around. Just 
within reach of the candidate (when he was in the room) were a flat 
monkey wrench and some boards with their ends chipped so that they 
would not balance readily on the flat surface of the concrete floor. 

The candidate was brought in and told that he had a very simple task to 
perform, The walls of the room, he would assume, were covered with wet 
paint which should not, under any circumstances, be smudged. His job 
was to construct, with the materials available, a stable coat hanger upon 
which he was then to hang his coat. He had ten minutes for the job. 

At the end of the instructions, the examiner conspicuously snapped his 
stopwatch, and began setting down notations on his scoring pad. In half a 
minute he announced that ‘‘more than a minute and a half are already 
gone.” After the candidate had picked up the three boards and the wrench, 
and had begun building a wobbly tripod, the staff member said: Well, that 
doesn’t look too solid or too resourceful, does it?” 

The examiner’s demeanor would change from a long-suHering to a super* 
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cihous attitude, as he became increasingly critical in his remarks, and finally 
°u » ^ boards continued to slip, the coat was not hung uo 

the paint” became increasingly smudged, and the candidate’s state progres 
sively more unhappy. Finally the test was brought to a close. 

At the end of the period the staff member explained the purpose of the 
test. Relieved to hear that they were not "unresourceful" after all, candi- 
dates would often be' inclined to describe how they would have acted under 
other circumstances and how, indeed, they had behaved in the past, thus 

giving firsthand accounts of previous frustrating experiences and their 
reactions to them. 


Stress,— Similar to the procedure at Station S, 


Post-Stress — Also similar to the procedure at S. 

The evening ended with the Party. 

The P,m-ty._This was ostensibly a period of relaxation for the staff as 
well as for the candidates and was given on the final evening of the assess- 
ment program as an “expression of gratitude” for the candidates’ coopera- 
tion. It was scheduled following the Stress and Post Stress Interviews 
and because the stimulation of these two situations climaxed several 
strenuous days, a social period complete with hard liquor was gladly ac- 
cepted by the candidates. The general tone maintained by the staff was one 
of casualness and conviviality, but the candidates were continuously ob- 
erved for sipificant patterns of reaction now that their tongues were 
loosened by the post-assessment release and the consumption of liquor. 

reti • a endeavored to encourage the participation of the more 

retiring members of the group, for a few of these the situation appeared 

u k j *^een. Some men, however 

who had had little occasion to feel at case before, suddenly became chief 
entertainers, if not leaders. ^ Liccamc cnier 


rwuKin morning 


Jr! assembled and requested to write a one-page per- 

wereV^ssJmbl °I ^^!l classmates. After finishing these the men 

Atter lunch, they were reiurnecl to the Los Angeles office. ^ 

Report.— The schedule at WS, in contrast to that at S, allowed the staff 
each candidate after the assessment process was concluded. ^ 
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STATION F 

In the fall of 1944, one of the large OSS training stations, Area F, was 
transformed into a center for the reception and reallocation of personnel 
returning from the European and Middle East theaters of operation. In 
reaching a decision as to which of these men were suitable for missions in 
the Far East, the administrators of the OSS concluded that a few mem- 
bers of the assessment stall might be of some assistance. It was foreseen 
that a large group of returnees, perhaps a hundred or more, would reach 
Washington every week or two, and, for several reasons it was agreed that 
the disposition of every one of them should be settled, if possible, within 
a few days after his arrival. Therefore, the size of the psychological staff 
being limited, the time available for the examination of each returnee was 
very brief, no more than an hour or two per man. 

The program adopted at F consisted simply of an interview which 
was partially based on the responses to two questionnaires that had just 
been filled out by the candidate. 

Although the primary objective of this program was to determine fitness 
for service in the Orient, it could also be used as one method of estimating 
the effectiveness of each man in performing his last OSS assignment, and, 
so, in the case of every returnee who had been previously assessed at S or 
at W, of validating assessment ratings and recommendations. How this was 
done is explained in detail in Chapter IX in the section on Reassignment 
Area Appraisal 



Chapter VIIl 

ASSESSMENT OVERSEAS 


CEYLON, INDIA, AND CHINA 

Assessment in the United States had accumulated a large store of experi- 
ence, and had developed elaborate theories and methods for assessing Amer- 
ican personnel. Assessment in the Far East, however, was faced with a host 
of new problems not encountered before. Further, the demands of the situa- 
tion, as had been the case in the United States, were such that work had to 
be started without the advantages of a preliminary survey or a careful 
evaluation of procedures. 

In August, i 944» ^ small staff was landed by plane in Colombo, dispatched 
by train through the mountain country of Ceylon to Kandy, deposited in 
the center of a large tea and rubber plantation, and told to go to work. 
Thus was assessment introduced to this part of the world, a land of many 
peoples of contrasting cultures, languages, and habits, and of attitudes 
strangely different from our own; a part of the world where each of the 
many racial, religious, and national groups understood little about the 
others, and distrusted or hated them for reasons that sometimes go back far 
into the past. 

Far Eastern assessment had its headquarters in Ceylon for about eight 
months; it was uprooted and sent to India, establishing itself on an oasis 
among paddy fields in the Province of Bengal; then it moved on to the 
grave-studded hills near Kunming, China; and finally reached Shensi 
Province to undertake a job in the mountains near FIsian. 

With each transplantation came the problems of cultural differences and 
unfathomable motivations. In Ceylon the predominant cultural influence 
of the recruits was Burmese and Malayan, in India it shifted to Thai, in 
Kunming to a mixture of numerous subcultures of China, and in Hsian to 
the Korean with a tint of the Japanese. With the changes in cultures and 
nauonalities came the changes in languages and dialects. The interpreters 
who had begun to understand the objectives and techniques of assessment 
in Ceylon found difficulty in India and \vould have been unable to carry 
on in China. With these changes there were accompanying shifts in the 
required qualifications of the individual candidates. They entered Burma, 
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Malaya, and 1 haiknd as agents in groups o£ five or six, and often without 
the supervision of American personnel. The personality traits required of 
them were different from those needed in China, where field operations 
involved highly organised units as large as i8o men under Chinese and 
American officers. 

The many demands, new problems, and unpredictable changes constantly 
confronting the assessment staff were met philosophically. For, regardless 
of how unfavorable conditions were at times for making careful evalua- 
tions of candidates, it was felt that the tools of assessment were sufficiently 
flexible to meet almost any situation. Applying them could contribute, to 
some extent at least, toward raising the standard of the personnel sent into 
occupied country. 

Assessment, as in Washington, was directed primarily toward the 
estimation of those general qualities of personality judged by the operating 
branches to be essential for work in the field, rather than toward the 
measurement of specific abilities. There were exceptions: occasionally, for 
example, there was an urgent need for radio operators, and tests for code 
aptitude had to be employed. Circumstances usually required, however, that 
emphasis be placed upon an over-all personality evaluation. Missions into 
the field developed in accordance with changes in the military situation, 
often precluding long-range planning. The agent personnel for these enter- 
prises were taken from a reserve pool where they had been placed after 
several months of training. As a result, at the time of assessment, informa- 
tion was rarely available on the specific type of work that a candidate 
would be called on to perform. 

The variables considered to be of primary importance by field operators 
were motivation for the assignment, dependability, and courage. In addition, 
it was necessary to know something about the recruit’s ability to learn (in 
view of the rigorous period of training that was to follow) , his ability to get 
along with others, hivS emotional stability, his initiative and practical judg- 
ment, and his capacity for leadership. 

It was not possible to apply American norms to the behavior of Orientals. 
Leadership, for example, manifested itself in different ways. In a Javanese 
group the leader played the role of helping others to accomplish their special 
duties rather than directing them. In discussion groups there was frequently 
no debate in the American sense; rather, there was an attempt to overcome 
differences and ease Into an agreement, Among the Karens examined by us, 
however, leadership had more of the characteristics with which Americans 
are familiar. 

This was in contrast to the Chinese, who almost invariably paid deference 
to the oldest member of their group. This was true regardless of whether he 
possessed the necessary experience or had demonstrated outstanding ability, 
His position would be still further enhanced if he had had more than the 
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average amount of formal education. If in attempting practical group prob- 
lems he failed to offer a solution, the work would not advance, Activity in 
progress might stop abruptly if he suggested another approach, the group 
being willing to accept it without critical evaluation* In discussions there was 
a reluctance to challenge his opinions. 

In the evaluation of leadersltip socionietric data were not so useful as in 
the United States. The Chinese recruits, for example, would be apt to base 
their choices, not upon manifested ability, upon evidences of good judgment 
or of initiative, or even upon age in spite of the deference paid to it, but 
rather upon friendship, Living close to the margin for centuries, the Chinese 
peasants took part in the competition for survival by forming closely knit 
family units or clans and relying on tested personal loyalty. With those out- 
side this magic circle there was little mutual trUvSt or sympathy* 

The estimation of motivation also presented problems. In Ceylon and India 
most of the natives who accepted assignments with the organization did so 
because of the pay they were promised Some were ‘‘impressed” into service, 
Naturally they were not ovcrenthusiastic; they were employed by foreigners, 
were asked to learn foreign ways, and to risk their lives for a cause which 
was not intimately related to their personal interests. War morale, as we 
knew it, did not exist in any theater in the Far East* The Chinese recruits 
in Kunming were drafted soldiers relatively unaware of the issues for which 
they were fighting. One recruit hesitated when asked the question, “Whom 
are the Chinese fighting?” Finally he answered, “The Airericans.” 

Instead of attempting to estimate motivation to fight the Japanese, there- 
fore, the staff asked these questions as to motivation for assignment; 
Do the recruit’s history and his performance during assessment present any 
reasons for doubting his disposition to carry on in the field? Do his early 
environment, his work history, his attitudes toward the tasks that were pre- 
sented to him, his apparent interest and initiative, together with his expres- 
sions of willingness to engage in the work, cast doubts on his intentions to 
execute his mission ? Does he catch the spirit of his group, adopt its objectives, 
and participate to the limit? Or, on the other hand, docs he present a history 
of shady dealings, of irresponsibility, or of egocentric attitudes antagonistic 
to team cohesion? Has he been sly or tricky in his dealings with the stall, 
avoided work, ducked out of his assignments? On the basis of all these 
sources, a judgment was made, not an cslimacion of motivation per se, but 
rather of those trends and tendencies in his personality, related in part to 
dependability, that might affect the constancy of his endeavor. 

The measurement of courage or daring also revealed interesting deviations 
from American standards. On the one hand, the Karens consistently demon- 
strated a high degree of personal valor in test situations. It is a trait which 
is^ supported by their cultural expectations. They have been driven into the 
hill country by the Burmese, an enemy whom they despise, and who in turn 
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regard them as inferior. As a minority group, they have taken a defensive 
position, avoiding contact with the cities, living instead in small villages in 
the hills to minimize the dangers of aggressions from their enemy. For pur- 
poses of self-defense and hunting in the jungles they have learned the use of 
weapons. And in the growing boy, who is taught to use them, emphasis is 
placed upon courage as an attribute of the man. The shy, undemonstrative 
Karen was a dependable and highly valuable ally in the Burma theater. 

In contrast to this group, lack of daring appeared so frequently among the 
Chinese that it was natural to look for cultural determinants. One factor, 
mentioned above, is the respect paid to the dignity and wisdom of age rather 
than to the distinctions of youth— athletic physique and prowess, motility, 
impulsiveness, adventurousness, flexibility, dash, and speed. Age cannot be 
successfully challenged by youth. In contrast to the rapidly changing culture 
of America, where age is associated with outmoded forms of thought and 
action, Chinese modes of life have a venerable static quality which is best 
represented by and most congenial to the older members of the population. 
In China the last years of a man’s life are spent on a plateau at the summit of 
his experience; in America they take a declining course which calls for a 
renunciation of influence and prestige. 

There are other determinants. The Chinese are inclined to compromise 
differences rather than resort to force. Children, instead of quarreling, take 
their disputes to an older member of the family for settlement. Emphasis is 
placed upon harmonious Interpersonal relations as an end in itself. Also, of 
all classes, the scholar, the man of thought and learning, is most highly es- 
teemed, the military class being placed far down on the social scale. In a 
Chinese family it is usually the least promising of the younger sons who is 
selected as the one to serve in the Army. He is the black sheep, the boy with- 
out scholarly aptitude. The disposition to compromise is found within the 
Army itself; to defend rather than to take the offensive, to retreat rather 
than to engage in serious hostilities. These are a few of the reasons, ap- 
parently, why physical ability and daring are not so generally esteemed in 
China as they are in some other cultures. 

In view of the complexity of the judgments to be made, a long assessment 
period was employed when practicable. It required more time to become 
acquainted with the men, and with a limited staff, more time to secure the 
necessary number of observations and measurements. A prolonged period 
was well suited to the program in Ceylon, where assessment itself was im- 
bedded in a preliminary training program; it was well adapted to the pro- 
gram at Camp I in Calcutta, where a work-sample method of assessing 
special aptitudes was employed on a limited scale; but it was not practicable 
in Kunming, where 200 recruits were needed immediately, nor in Hsian, 
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where the staff was also under pressure. As a policy, assessment units used 
all the time that was available. 

At no time during the period of assessment in the Far East were men 
recruited in numbers sufficiently large to permit as high a rejection rate as 
the staff would have liked. The demands for agent personnel were almost 
equal to the rate of recruiting, and each man rejected by assessment meant 
a delay in sending operators into the field. Borderline cases were carefully 
scrutinized and often passed with qualifications if they seemed suitable for 
any type of work. This compromise would not have been necessary if the 
recruiting branch had provided a larger .sample. This need for compromise 
between quality and quantity added to the problems of assessment and in- 
creased the probability of error. 

A problem that was recognized, but for which no solution was found 
was the variation in attitudes toward tlie Oriental by American personnel 
and the attendant variation in the treatment he received. During the period 
of assessment every effort was made to become acquainted with the recruit 
as an individual. In order to do this, more courtesies and greater considera- 
tions were extended to him than Europeans arc wont to extend. Besides 
conforming to the basic assumption that it was due him, this treatment was 
revvarding in terms of better cooperation. But it was more friendly and sym- 
patietic than the treatment meted out to him by the average American 
so icr. This difference became an important issue in the field in some in- 
stances. The failures of a few native agents on missions were explained by 
claiming chat they had been spoiled during the training period by luxuries 
and an unduly solicitous attitude. When returned to their native ways of life, 
as IS often necessary under field conditions, they became rc.sentftil or defiant! 
Complete reports are not available on this point, but it is altogether probable 

that a contributing factor was the scornful, if not abusive, manner of the 
typical GI. 

Security was another problem with which assessment had to deal. There 
was constant danger that candidates would learn too much about the organi- 
zation during the period of testing and that those who were rejected and 
rcturne to the place of recruitment would carry information with them 
that should not be spread abroad. This problem was eventually solved in 
out East Asia Command (SEAC) by establishing the assessment unit in 
India, thus removing recruits from all possible contact with training and 
operations conducted in Ceylon. The problem did not exist in China, for 
there there were so many potential leaks via interpreter, houseboys, and the 
like that it was useless to take precautions. 

Among the ever-present problems was that of the lack of men trained in 
assessment methods. Something was accomplished by training the American 
personne assigned to the unit to serve as assistants, but they, as a rule, were 
not permanently attached. The interpreters on the staff were also changing 
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constantly, so that during some of the time the senior staff members had 
the benefit of no observations other than those which they were able to make 
for themselves. 

A small stafl restricted the scope of the testing program and complicated 
the problem of scheduling. During interviews conducted by the senior staff 
members, for example, many individual and group tests could not be given 
because for these the presence of an experienced observer is required. Since 
an interview conducted through an interpreter often lasted from three to five 
hours, this procedure took up an appreciable slice of the day. The problem 
was met by having a longer assessment period. 

The assessment programs varied from place to place according to the con- 
ditions and requirements in the theater. In terms of staff, in Ceylon there 
were two senior members, eight instructors, and two interpreters; in India, 
one on the senior staff, three instructors, and two interpreters; in Kunming, 
four senior staff members and seven junior staff members who were also 
interpreters; and in Hsian, one on the senior staff, one instructor, and three 
interpreters. That is only part of the picture, however, for the rate at which 
recruits were processed varied. In Ceylon approximately 120 men were as- 
sessed in eight months; in India 20 men in one month; in Kunming ap- 
proximately 800 men in thirty days; and in Hsian 40 men in ten days. 

The type of assignment for which the men were being trained, as indicated 
earlier, also varied. In Ceylon, India, and Hsian (China), the men were to 
operate in occupied country as individuals or In small groups of lour to six, 
while those in Kunming (China) were to be trained to work in combat in- 
telligence units of approximately 180 men. 

In spite of these differences in operating conditions and in requirements, 
the methods employed by assessment throughout the Far East were similiar, 
varying only in details. An interview, even though very short, was always 
part of the schedule. Outdoor group tests were invariably included, the prob- 
lems selected being those best suited to the terrain at hand. Individual tests 
were also given, the number depending upon the amount of time available. 
Psychometric tests of one sort or another were likewise considered essential. 
The unique features of assessment in each of these theaters are described in 
the sections following, 

ASSESSMENT IN CEYLON 

Twenty miles from Kandy in the mountains of central Ceylon, assessment 
set up its first headquarters in the Far East, It was to be known as Camp K. 
The quarters, high on a hill in the center of a 1,500-acre tea and rubber 
plantation, commanded a view of rugged tropical country for miles around. 
Two building units were available for use, close together as the crow would 
fly across the canyon which separated them, but two miles by a winding road. 
The larger unit consisted of what had been the Mount School, and was the 
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place where the recruits were housed and where most of the classes and inter- 
views were held. The smaller unit, the Eastern Bungalow, provided quarters 
and office space for several members of the stall, as well as for a few recruits 
who had to be kept separate from the others for reasons of security. 

There was much to be done here before the assessment unit could be put 
into smooth operation. After the two staff members from Washington had 
arrived, there were instructors and interpreters to be found and trained, a 
schoolhouse in bad need of repair to be put in order, and a program of assess- 
ment to be developed which would mesh with the needs of the training and 
operating branches of the organization, Supplies were scarce, ancl the OSS 
was new in the theater, so that the problems of administration were for a 
while acute. Work began immediately, however, and during the course of 
the following period these difficulties were ironed out and a program was 
evolved adapted to the plans for operations in that theater. 

Candidates were obtained from many sources. Some were recruited in 
Calcutta, where the recruiting branch of the organization had its headquar- 
ters. These were for the most part Chinese who daring the war had filtered 
into India from Burma, Malaya, and Indo-China. Tlicy were selected for 
their familiarity with those regions. Few of them were native horn; rather, 
they classified themselves as ‘‘overseas Chinese.” Some recruits wore obtained 
in northern Burma and Assam. The Karens came from these areas. Others 
were secured by the British, in a sense impressed into service, for they were 
picked up from junks by submarines cruising along the coast.s of Burma and 
Java, and after interrogation, would be turned over to the Americans. Some 
were obtained in the United States, and some in Ceylon. 

For reasons already indicated, the descriptions of the candidates in terms 
oi- personality variables presented problems. Although these variables were 
used as points of reference, they were not emphasized, and statements about 
them were qualified. An effort was made, however, to give as full and com- 
plete a sketch of the recruit’s total personality as possible. Patterns of be- 
havior, basic drives, and anxieties were looked for and evaluated. In view of 
^ j r recruits would have to pass a rigorous course in training 

an the fact that the exact nature of their assignment was unknown, the staff 
attempted to predict performance at the training camp as well as perfor- 
mance on missions. Not infrequently recommendations were made as to the 
kind of work for which a candidate was best fitted, as well as the kind of 
work tor which he was least fitted. 


Ihe problems of assessing Orientals, with their wide range of cultural 
backgrounds and language dlTerences, were such as to make the longest 
practical assessment period advisable. Fortunately time was to be had A 
rce weeks program, it was judged, would not impede the schedule of 
planned operations But in order to advance the men as rapidly as pos- 
it was decided to give them basic instruction in the courses which 
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they were to take later at the training camp and to assess them while they 
were engaged in these activities. This plan had certain definite ad\antages. 
Assessment could concern itself with specific skills and qualities of person- 
ality necessary for the job. It could serve as a probational period of train- 
ing. Further, by burying assessment in training exercises the staff could 
operate, as it were, under cover. To all appearances they were instructors, 
not assessors. Accepting it as a training school, the recruit would be less 
apt to put on the protective cloak worn by a man who feels that he is 
under the eye of scientific scrutiny. 

The procedures which constituted the final program of assessment in 
Ceylon can be grouped into three categories : Clinical Interview and Psycho- 
metric Tests; Group Situations; and Training Exercises. 

Interview. — The Interview was usually conducted through an interpreter 
with objectives that were essentially the same as those accepted in the 
United States. It was directed first at obtaining a detailed account of the 
life history of the recruit, beginning with the first events he could remem- 
ber, For the interviewer the recurrent question from first to last was: “Is 
this situation typical of the man’s culture or is this a special, fortunate or 
unfortunate, circumstance to which he was exposed?’* The interpreter was 
often of help here, for he could describe the customary pattern of life at 
this age in this environment. The incidence of bed wetting, for example, 
until the age of seven or eight was frequent, but it was found that the 
parents paid little attention to this habit. People in their community did not 
use eiderdown mattresses and white sheets and quilts, but slept on straw 
mats on the floor with a rough blanket, and it made little difference whether 
bladder control was learned early or late. Such problems call attention to 
the background of cultural knowledge which is required of assessors, some 
of which must be obtained during the Interview. This, to some extent, ac- 
counts for its much greater length — four or five hours in most cases. 

Although attempts at deception were encountered frequently, for example, 
to conceal desertion from the Chinese Army or to conceal the use of opium, 
at the end of the Interview it was usually felt that a reasonably accurate 
history had been obtained. The attitude of these men toward the Interview 
was generally naive; questions directed at determining beliefs, habits, and 
attitudes were answered frankly and often with less embarrassment or self- 
consciousness than is found in North American culture, The Interview, as 
in the United States, formed the nucleus about which were fitted the ob- 
servations of behavior made in other situations. 

Psychometric Tests.— Psychometric tests were given soon after the recruits 
arrived at Camp K. Included in this battery were the Non-Language Tests 
2a and 2C from the Adjutant General’s Office; the Series Completion, Paper 
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Form Board, and the Block Design Tests (with Kohs Blocks) ; the Wechsler 
Mental Ability Scale, Form B; OSS Memory for Designs; Matrix Test 
(twenty-minute version); a Figure Analogies Test; and a Word Associa- 
tion Test designed at Camp K, These tests were usually given individually. 

No standardized directions were adopted; rather, the interpreter gave 
general instructions, until the recruit either understood the task or showed 
that he was entirely incapable of understanding it. A time limit was set 
for certain tests in order to differentiate more sharply between recruits. 

Although most of these techniques are generally classified as testxS of in- 
telligence,*’ it was obvious that in the case of these recruits other factors 
were involved, Schooling was one. Often a recruit had not learned such 
an elementary operation as the use of a pencil, and a fellow recruit would 
have to write the answers for him. In addition, the attitude toward these 
tests— keen interest at one extreme and at the other blind submission to the 
incomprehensible whims of a white man — was partly a function of school 
experience. Thus in the evaluation of the scores of a particular recruit at 
Camp K the past history as well as the over-all attitude had to be taken 
into account. 

Memory for Design Test.— This test called for reproducing certain figures 
exposed for a short time. Its validity was questionable, since many students 
who did poorly here showed keen powers of observation in outdoor assign- 
ments. 

Word Association Test.— This required the candidate to speak the first 
word that came to mind after each of a series of stimulus words. The aim was 
to provide clues on matters of emotional significance, for example, fear of 
solitude, tendency to homesickness, and so on. In practice, because of the 
difficulty in determining the range of normal responses, little weight could 
be given to the results of this test. 

The Sociometric Test. — This was used, as in the past, to obtain informa- 
tion on social relations within a group, to determine who were^ considered 
the leaders, who were friends, and who were disliked and why. These were 
important questions to settle because an outbreak of hostility in the field 
might threaten the success of an entire mission. A standard series of ques- 
tions was asked. 

Group Discussion.— This was an informal meeting held to discuss post- 
war problems. It revealed political attitudes, leadership ability on a verbal 
level, and features of group structure which had not appeared in other 
situations. Beer served on these occasions augmented the vigor of the argu- 
ments. 
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Group Projects — Some objective was set for each group of recruits. One 
class built a relief map, another a part of the rifle range. As a rule the 
recruits were given the problem and allowed to solve it in their own way. 
During the undertaking they were observed by a staff member who made 
notes on intelligence of ideas, attitudes toward the problem, willingness to 
work, relations between members, leadership, cooperativeness, and so forth. 

Code Training Course. — This was started in November, 1944, as soon, as 
the installation of equipment was completed. The recruits were taught 
first to print the alphabet and then were drilled in the use of the code itself, 
learning at the same time to send and receive, A series of lessons, graded 
in difficulty, were automatically sent over the earphone systems, the recruits 
copying the letters as they heard the sound symbols. Part of each day was 
spent in communicating with one another. At the end of three weeks of 
daily instructions aptitude and interest in this type of work were usually 
indicated. 

Use of the Compass. — A knowledge of the use of the compass was basic 
to mapping and to locating objectives in unfamiliar country. Field prob- 
lems were started early. After preliminary instruction in reading the instru- 
ment, compass runs to various objectives were given. They were graded 
in difficulty. In conjunction with this course, instruction in camouflage and 
evasion was included. Attitudes toward the course, persistence, and speed 
of learning were readily observable. 

Close Combat and Weapons. — This was a course that was valuable for 
the information it yielded on the recruit’s general physical condition and 
coordination. Approximately ten hours were devoted to instruction, and 
during this time valuable data on social relations were secured; attitudes 
toward members of the group and willingness to use **dirty” tactics, such 
as gouging eyes and squeezing testicles, were often significant. 

Part of the time was devoted to instruction in the use of the ,45 caliber 
automatic pistol. Here a type of mechanical aptitude was measured. Further, 
in firing the weapon, anxiety or timidity in some and confidence and inter- 
est in others were very evident, These were important things to know about 
a man before sending him into the field. 

Mapping. — In this course the fundamentals of map reading and to some 
extent sketching and map drawing were taught. The instructor had to 
start with the most elementary concepts of space representation, but sur- 
prising progress was made with training. Since certain features of the course 
were generally regarded as disagreeable, any tendency toward laziness or 
inclination to shirk work was quickly revealed here. 
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Morale Operations.— This course, iiUroduccd late in tlie program, was 
conducted as a modified seminar and discussion. It was perhaps more 
frankly an assessment tcchnkjiic than was any other single course. The 
war attitudes of the students and their sensitivity to social atmosphere were 
revealed through comments on war pictures and varicjus movies held at the 
camp. Through a staged interview, where the instrucujr was questioned 
by recruits, ability to gather morale intelligence was assessed. Various morale 
operation techniques were taught through the production of cartoons, leaf- 
lets, rumors, and radio speeches. 

Observing and Reporting. — Here both instruction and assessment were 
attempted by presenting recruits with problems of varying complexity. 
Several types of objects to be observed and reported on were used: a table 
covered with objects, a human being, an abandoned camp site, a near-by 
village. The reports could be checked for accuracy, and estimates made of 
the candidate’s ability to search, tc communicate ideas, and to infer from 
observed data. Studies of the significant parts of planes and ships offered 
further opportunities of testing ability to observe and report, and served 
to facilitate aircraft identification studies at the training camp. 

Review Compass Course. — To complete this course, a knowledge of the 
compass, of map reading, of sketching, of observing and reporting, of 
camouflage and evasion was required. Recruits followed a compass course 
past a Tamil village to a booby-trapped house which they were to search. 
On the return trip they had to evade “patrols.” Observers were posted along 
the way to note appropriate and inappropriate behavior. Here data were 
secured on how well candidates had learned the subject matter in the several 
courses prerequisite for this test. The men had 640 yards of very rugged 
terrain to traverse at night without lights. Emotional reactions to the dark 
or to the jungle were occasionally evinced. 

Jungle Problem. — This was not introduced until January, 1945, when it 
was substituted for Group Projects. After being briefed on jungle survival 
and selecting their equipment for the trip, the recruits proceeded by bamboo 
rafts to a jungle area. Here, under concealment, they made camp and spent 
the night, returning to the assessment center on the following morning 
via a specified route which had been booby-trapped. A critique of their 
plans and actions was initiated immediately on return. This furnished an 
opportunity to observe reactions to stress, to fatigue, and to uncomfortable 
conditions, and how the men concealed themselves and met various prac- 
tical problems along the way. Instructors accompanied them as observers 
over the whole course. 
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Whether or not these situations and these courses actually evoked behavior 
relevant to the future missions is problematic. In retrospect, the compass, 
so much stressed at K, 'was not a good choice, for it was contraband which 
was dangerous for a native to have in. his possession and unnecessary in 
familiar terrain. Criticism of other training procedures could also be made. 
The staff felt, nevertheless, that distinct differences in general and special 
capacities, in energy and morale, in social relations, and in leadership were 
clearly exhibited over the threc-wcek period. 

Preparation of tlie Final Report. — The assessment process was brought 
to a focus at a conference where opinions about the recruits were expressed 
by each member of the staff, assessors and instructors alike. The scores, 
observations, impressions, and hunches collected from the interview, the 
psychometric tests, the situational tests, and the instructional exercises were 
all reported and carefully considered in coming to a decision as to the suit- 
ability of the candidate. The report written after the conference consisted 
first, of a brief chronological resume of the recruits life history, second, of 
descriptions and interpretations of his performances at Camp K, and third, 
of a brief summary followed by the recommendation. 

Characteristics of Recruits Assessed, at Camp K.— The ninety recruits 
who were assessed during the first five months differed widely among them- 
selves— in racial origin, in languages spoken, in age, in civilian occupation, 
in education. They were recruited in various places (ranging from New 
York City to Calcutta) and in various ways. Twenty-seven were impressed 
by British forces, 20 were recruited in Calcutta, 14 in Surinam, ii by a 
Thai representative in the United States, 7 in Colombo, 4 in New York 
City, 3 in Burma, 3 through various sources in India, and i was recruited 
from the United States Army in Australia. 

Nine different races or nationalities were represented: Chinese (38), 
Indonesians (18), Thai (12), Burmese (9), Tamils (6), Darnes (3), Malay- 
ans (2), Indians (i) and Burmo-Amcricans (i), The geographic origins of 
these 90 recruits were even wider and more varied than their national origins. 

Of these go recruitxS, most of whom were being assessed for highly special- 
ized OSS activities, 52 had never had any military training, 32 had a bare 
minimum, and only 6 had had actual combat experience. In most cases his 
civilian occupation had scarcely prepared the candidate for OSS operations. 
Eighteen of the 90 were mechanics or truck drivers; 16 were crew members 
or operators of junks and fishing boat.s; about 30 had engaged in relatively 
unskilled labor, such as that of plantation workers, coolies, houseboys, 
farmhands. There were about 19 “intellectuar’ workers— teachers, trans- 
lators, interpreters, and students. 

The range in formal education corresponded to the range in occupations. 
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Eighteen had had no formal education whatsoever. Forty had attended 
native schooLs, a number of them reporting that they had “learned nothing” 
there. Seventeen had attended English-speaking or missionary schools, and 
15 had attended college, either native or foreign.^ 

This wide range in origin, training, education, and occupation also re- 
flected itself in the languages spoken, written, and read by the recruits, 
Thirty'seven spoke English; the rest spoke a variety of other languages, 
including French, Chinese (eleven different dialects), Thai, Japanese, and 
Arabic, The problem of communication between the recruits and the as- 
sessment staff was an ever-present one; but since most of the recruits were 
multilingual, only a few interpreters were required. 

-Over 55 per cent of the recruits were in the age range between 14 and 29; 
the average age was 30 years; the youngest recruit was 14, the oldest 53 
years. Forty-eight of the recruits were or liad been married and 27 of these 
acknowledged having children. 

The chief formal characteristics distinguishing the 29 rocuiis who were 
rejected from the 61 recruits who were recommended are hardly worth 
reporting in detail. The rejected recruit was apt to he older than the success- 
ful rccruiti The average age of the former was a little over 32, hut that of 
the latter was about 29 years* 

National origin wa.s also a differentiating factor between the successful 
and unsuccessful recruits. Almost half of the rejected ones (48,2 per cent) 
were Indonesians, this despite the fact that the Indonesians comprised only 
20 per cent of the total assessed population. To be more specific, of the 18 
Indonesians who were assessed at K, 14 were rejected and only 4 were 
recommended for further training. On the other hand, all 12 Thai passed 
the assessment course successfully. It is not possible to .say Avhether this 
difference was due to a difference in the standard maintained by the several 
recruiters (the most likely explanation), or to educational differences, or to 
some general cultural determinant. 

Degree of education was another factor. Though 31 per cent of the failing 
recruits had no education, only 15 per cent of the successful recruits were 
similarly handicapped. On the other hand, 21 per cent of the successful 
recruits had had some college training, whereas only 7 per cent of the fail- 
ing recruits had enjoyed this advantage. 

In short, it appears from the data available that the only significant formal 
differences between the successful and unsuccessful recruits were amount 
of education, nationality (Indonesian), and, to some extent, age. The other 
differences seem to have been either negligible or derived from these. 

’■Among the foreign universities and colleges represented were the University of Edinburgh, 
University of California, California Institute of Technology, University of Pennsylvania, Yale 
University, Massachusetts Institute of Technology, University of Illinois. 
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Illustrative Cases of Rejected Recruits. — The reasons for rejection at 
Camp K were various— low intelligence, lack of dependability, emotional 
instability, physical deficiency, laziness, cowardice, and so forth. The follow- 
ing abstracted case records describe four typical rejectees; 

Case of a recruit who was rejected because of an incompatible or difficult per- 
sonality: 

No. 3 Age: 36 Tamil Born in Madras, India 

Schooling: When 14, graduated from a college in India. 

Occupational History: At 16, became an instructor in a girls’ school. In 1933, 
acquired a position in a Training College in Madras. Taught classes in production 
to civilians and troops for one year. In the spring of 1942 he was ordered to 
“revert to the Training College” which he regarded as an injustice. After obtain- 
ing a leave of absence on medical grounds, he resigned in March, 1943. He then 
held the position of inspector of food production for the government until he 
was recruited for OSS in July, 1944, 

Summary of K Report: Well educated with excellent command of English, 
adroit in verbal expression. Quick at understanding but equally quick to make 
excuses when he made errors or failed in details in practical work. Gave the 
impression of appearing “superior.” He was not liked by others, was obviously 
pointing toward a teaching position, not toward operations in our organization. 
Had questionable physical stamina and the poorest coordination of anyone in the 
group. 

It seemed doubtful that his needs and our needs could come together in a 
smooth and happy solution. On ground of doubtful personality development and 
incompatibility with our own personnel, it is recommended that a permanent 
appointment in this organization be avoided. 

Case of a recruit who was rejected because of emotional instability: 

No. 61 Age: 23 Malay Born in Singapore 

Schooling: In Malaya from 8 to 10. In a university in India from 11 to 18. 
Occupational History: Translator for Indian Government. 

Summary of K Report: A pleasant, quiet, gentle-mannered, and inactive recruit. 
Frequently smiles or laughs in conversation, but recently has been more somber 
and has shown considerable anxiety and even mild depression. Avoids strenuous 
work for the most part, but could be pushed into it, in which case he might 
later develop complaints of fatigue or headache, etc. Implied knowledge of 
mapping, weapons, mathematics, but was quick to evade the issue when chal- 
lenged to demonstrate his familiarity. Interviews were not revealing. He would 
“misunderstand” or have “difficulty in explaining” or would repeat previous 
statements. In some instances he would make flatly misleading statements ap- 
parently to cover his inadequacies. His intellectual ability was slightly above 
average; memory, average; observation, below average. 

This recruit had known Captain R since childhood. Was brought into this 
organization through the Captain’s Influence. Is extremely dependent upon the 
Captain, fears that the Captain has dropped him and ascribes his anxiety to that 
specific concern. Would probably need continuous bolstering by the Captain (or 
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an equiTalcnt person) to keep going, and even tlicn he wonld he unreliable unde, 
physical or psychological stress. 

.Ivl" b‘;i-ause of lark of initia. 

, ack of physical stamina, and presence of eiiuitional insUihility, 

Cart of a recruit who was rejected primarily because of intcUccitial limitation; 

^ 3 *^ Chinese Horn in Malaya 

Schooling: Chinese school 2 years. 

Occupational History: Clerked in father's store from y to ly, then worked at 
apping ru her, and as a clerk in a rubber company. Drove trucks on Burnia 
ad for four ye.ars, drafted into Chinese Army, de.scrted, worked in U.S Armv 
camp m Burma, and in American Air Depot in Burma, as truck driver' ^ 
5 ««»mry of K Report: Qiuet, slow, inconsistent in performance, not riioecd 
rather srlent can be stubborn. Received low scores in intelligence tests, .Stowed 
no special ability to assume leadership or even to plan independently or to act 
effectively with initiative wlien thrown on his own. Could tvofk in a gfou[t ^nde! 

Low borderline case, 

^seof a recruit who was rejected because of laziness and undisciplined character- 

c ? r A 1®.."/“’ Born in Malaya 

Schooling: Anglo-Chinese school to first standard. Mitldlc school from 7 to 17 

3 i« chi..;; 

Occupational Histp; Teaching English in Malaya [or five months, After Pearl 
Ilarbor ran out of money m China and did odd johs-.sohl litpior, patent medi- 
uncs solicited advertisements for Jap-controlled organization. Pinal y made his 
way to unoccupied China where he acted as inte^cter for Arnericanrin an 
11011^ Training Center. Later worked as civilian clerk in the office for the 
U. b. Army in China, 

^ In his work at K he tried to avoid work requiring 

-fi" r motivation for any war work 

self cemfred «°Poratcd rather poorly with others; appearing 

orehltl, '! occasions definitely unreliable. Has a gonorrheal 

° rkd/aTar^ insfructors as 

se? nlrJrc^n^idtT^ '*P°i’od child." Has a history of 

gence and failure to attain ends requiring persistent effort. 

Rejection is recommended because of lack of sturdy, di.sciplined character. 


ASSESSMENT IN INDIA 


unng the first months of 1945, the percentage of rejected candidates 
rose from 33 per cent, which was well above the ideal figure, to 50 per cent 
in some classes. This rise was serious because not only did the periodic 
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dismissal of so many men increase security risks, but it testified to a large 
discrepancy _m the conceptions of fitness for OSS operations entertained 
by the recruiting officers on the one hand and the assessment staff on the 
other, and so to the wasting of a good deal of precious time and energy 
It was either that men of the desired caliber were not to be had anywhere 
or that the recruiters were not seeking and selecting the proper types, or 
that the standards of the assessment staff were too exacting. The problem 
was solved by moving the assessment unit from Ceylon to India, the inten- 
tion being to reduce the security risk, since only those men who were 
judged to be qualified wouM be sent to Ceylon and so thenceforth there 
would be only a very few rejected recruits to return to Calcutta with infor- 
mation which might prove valuable to the enemy. Furthermore, by bring- 
ing assessment and recruitment into close proximity, differences in view- 
points and standards could be resolved and a more efficient articulation of 
the two units effected. 

In April, 1945, assessment was on the road, leaving Ceylon to take up its 
work in the little town of Raniganj to the northwest of Calcutta. In the 
process, unfortunately, the staff was decreased to one senior and one junior 
member (one more to be obtained if possible), one instructor, and two 
interpreters. It was possible to get along without the services of more than 
one instructor since less time would be available for assessing the recruits, 
and training as a method of providing data for appraisals was to be aban- 
doned. A program of tests conforming to the pattern established at Station 

5 would be designed. 

The new site was located 130 miles from Calcutta in the western part of 
Bengal on the Grand Trunk Road to Delhi. It was in a section of the 
province that was devoted largely to coal mining during the hot dry season, 
January to June, and to rice growing during the monsoon season. A large 
“bungalow,” in local terminology, situated on an estate in the midst of 
paddy farms provided quarters and classrooms. This building had formerly 
served as the guest house of the Indian landowner of the area. The location 
was favorable in many respects: there was an adequate supply of water 
on the property, drawn from a well near the bungalow, and from a tank 
filled by the rains, which provided muddy water for washing purposes 
throughout the year. Supplies were readily available in the town of Asanol, 

6 miles away. On the property itself were many large trees and the remains 
of several stone buildings of unrecorded age, all of which offered inviting 
opportunities for setting up practical outdoor problems. 

Circumstances were, in general, favorable for an effective assessment pro- 
gram. The Air Corp.s was very cooperative; the 305 Air Service Group 6 
miles away agreed to provide commissary facilities, the services of their motor 
pool for maintaining the jeeps and trucks, and hospital facilities. Contact 
was also established with the Area Engineers, and with materials and per- 
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sonnel provided by them, construction of test equipment was started im. 
mediately. 

Once a week a new band of recruits was pickctl up at the recruiting office 
in Calcutta and brought out to the camp, each group being scheduled to 
stay twelve days. On arriving, the student, s were shown to their quarters 
in the bungalow, and issued 01 fatigue uniforms, sneakcr.s, and insect 
repellent, 

Following this they were assembled on the veranda for a short welcoming 
talk. Through the interpreter, they were told about the purposes of the 
program, the attitude that they should take toward the Interview and 
toward the tests, and the rules of the camp. They were advised about health 
precautions such as the use of insect repellent, sleeping under nct.s, drinking 
of boiled water, and so forth. At this time an assignment, to he completed 
during their spare time, was given: the Individual Projects for which each 
man was to start planning immediately. This ended the first evening. 

The schedule for the next six days, starting at <5:30 iti the morning, was 
devoted primarily to the measurement of code aptitude in conjunction 
with a preliminary code training course. Failure in code meant failure in 
assessment since for these candidates a proficiency in this function was a 
sine qua non of suitability. In order to break the monotony of this daily 
routine, however, and to provide other work during periods when it was 
too hot for instruction in. the code room, sonic tests were given: Psycho- 
metrics, the Pistol Assembly Test, and the Object Ol).servation Test, At 
the end of this period, with this Ixicklog of training, the extent of code 
aptitude possessed by the student was apparent. Further, after six days of 
associating with these men, the staff had become fairly well acquainted 
with them. The associations during meals, during per|od,s of relaxation In 
the living room, in the course of outdoor games, all provided opportunities 
for observation. 

In the second week, with the arrival of new students from Calcutta, the 
men who had finished code training became the “advanced group.” Their 
last six days would be devoted to a variety of undertakings cle, signed to re- 
veal significant traits of character. 

Each day, following toast and cofice served at 5:30 a.m., individual tc.sts 
and group tests were given outdoors. There was the Obstacle Course, the 
Parachute Jump Test, and the Track Meet. Breakfast wa,s at 8:00. At 9:00 
o’clock work began again. An interview was held at thi.s time, lasting until 
12:30, and often continuing into the afternoon. While both the interviewer 
and the interpreter (co-assessor) were thus occupied, only advanced train- 
ing in code or tests which required a minimum amount of verbal Instruc- 
tion could be scheduled. The program was so arranged, however, that few 
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tests were given without the presence o£ both the interviewer and the 
interpreter. 

Lunch was served at i:oo, and until the heat of the day had passed, no 
outdoor tests and a minimum amount of indoor work (other than com- 
pleting an interview) were required, At 4:00 p.m. the testing program was 
continued. The hour before dinner was usually devoted to recreation. 

Evenings were spent in obtaining sociometric data, in completing the 
Individual Project, in Group Discussion, or in recreation. The Discussion, 
encouraged by an ample supply of India’s best gin, was usually a productive 
session. 

This schedule continued until the afternoon of the last day, which was 
set aside for preparations for the trip back. At 10:00 o’clock that night the 
successful candidates boarded the truck for the drive to Dum Dum Airport, 
there to take the plane for Ceylon. Those who had failed were returned 
to the recruiting office in Calcutta. 

The various procedures will now be briefly described, beginning with the 
group situations. 

Wall Scaling. — In this test the candidates were brought to the wall of an 
old building and told that they must build a structure for climbing it which 
would be adequate for use by a body of men who were following them. 
They were provided with an axe, jungle knives, and rope, and told they 
could use anything on the property to aid them in the construction. Timber 
was available in the woods near by. The disintegrating walls of the build- 
ing were approximately 16 feet high. The Karens, with their background 
of experience in the jungle, were particularly quick and agile in solving 
this problem. 

Observation Platform.— This assignment required that the group con- 
struct a platform in a tree to serve as a position from which at least three 
observers could watch the surrounding area. They were told that it should 
be as high as practicable. The men would usually divide into a ground 
crew and a tree crew, the former gathering the materials and hoisting them 
by rope to the latter. The task was provocative of argument because of 
the decisions which had to be made and because of the differences of 
opinion which arose as to the best materials to use. Leadership, Social Rela- 
tions, and Effective Intelligence were the variables most easily estimated in 
this situation. 

Tent Erection. — A large pyramid-type Army tent was given to the men 
to erect as neatly and as rapidly as possible, The site selected was within 
clear view of windows in the bungalow, so that the staff, after giving the 
instructions and retiring, could watch them at work unnoticed. The job was 
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a tough one, for the ground was hard and the tent stakes could not be 
placed until holes for thcni had het‘n made ndth an iron stake driven in 
with a sledge, Further, ercciiiig one of these teius so that it is square and 
the side walls are of equal height is a task which rcciuircs accurate planning, 
On a hot day diis was not the pleasantest of assignments, and so it proved 
a good test of raotivation and persistence. Done properly, tl\is task took 
about an hour and a half to ccjmpleic. 

Aerial Erectiotr — This situation called for the erection of an aerial on 
an open stretch of ground. Rope, iron stakes, and two lengths of bamboo 
were provided. The solution involved setting up tlic two poles in a vertical 
position, with a line between, and supporting them adequately with stays. 
Although the solution was easy, the job required planning and teamwork, 

Discussion,-"As in Washington, the stuff took no part in the group dis- 
cussion except to raise further pertinent problems ^vhen the proceedings 
began to lag. Indian gin was used to release inhibitions, The undertaking 
was conducted with varying degrees of success, depending upon the intel- 
lectual level of the group, the relative ages of its members, the case with 
which the candidates understood each oiher^s dialect, and so forth. As 
described earlier, the presence of an older Chinese was a [it to reduce the 
amount of discussion, the others being inclined to accept his judgment as 
final. At times, differences in dialects would slow up the progress of the 
argument, one candidate having to iiiicrprct for anodicr. At other times, 
language would split the group into two parts, each proceeding independ- 
ently. On occasions, in the excitement, the dialect would shift, let us say, to 
Mandarin, which no one on the staff understood, and the men would 
have to be brought back to common ground, In spite of the fact that a 
good deal of what was said was missed, the discussion was often very pro- 
ductive, yielding data on attitudes, social relations, and so forth. 

Sociometric.— In order to obtain even a fraction of the desired informa- 
tion, it was necessary for the CQ-asscssor (interpreter) to take each candidate 
aside, present the questions verbally, and insist that he commit himself, 
An Oriental, particularly a Chinese, will generally avoid evaluating the 
qualities of another man unless he has been acquainted with him for a 
long time. This reticence is due in part to fear tliat his statements will be 
repeated (distrust of the stafl member), and in part to the fact that in 
everyday social intercourse a Chinese docs not accept a person as a friend, 
does not pronounce judgment until the man has stood the test of time, 
Relationships between them remain on a rather formal level, without many 
confidences, until the friendship, in the Oriental sense of the word, is estab- 
lished. Once attained, it has then the characteristics of a blood relationship. 
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About the traits of a mere acquaintance the Chinese is not inclined to 
speculate. He will say, “But I have not known him long enough”; or 
“True, but that is only one situation; he may be sociable (courageous, a 
leader, and so on) in other situations/’ There is merit in their insistence 
upon prolonged acquaintanceship, but it reduces the usefulness of the 
sociometric procedure. In spite of the difficulties, the data that were ob- 
tained made it worth the effort. 

Besides these group tests there were a number of individual tasks some 
of which, being similar to those discussed in the preceding pages, do not 
require comment. Several new ones, however, were introduced because of 
a greater emphasis placed on certain traits by the field operators in this 
theater. These will be discussed below. 

Psychometric Tests.— These were similar to those used in Ceylon. 

Pistol Assembly— This was a mechanical aptitude and practical intelli- 
gence test which was administered in the following way. The recruit was 
seated before the instructor and told that he would be shown how to re- 
assemble a regulation Army ,45 caliber automatic pistol. He was asked to 
watch closely, for the speed with which he accomplished his job was im- 
portant. The pistol was then field stripped, assembled, and field stripped 
again, the instructor indicating certain special features by pointing to them 
during the demonstration. No language other than the introductory remarks 
was used. The parts were then turned over to the recruit. Notes were made 
on his general approach to the problem, the skill and speed displayed. 

Object Observation and Memory — The recruit was allowed three min- 
utes to examine twenty-four objects arranged on a small table. He was 
tested immediately afterward by being asked to name the objects he re- 
membered. 

Observing, Reporting, and Inference — This test was designed to pro- 
vide another measure of memory, but, more particularly, to yield informa- 
tion on the individual’s ability to make sound inferences from available 
data. The candidate was taken to an “abandoned camp site” and told to 
survey the place carefully. After five minutes he reported to the interpreter, 
who recorded the things he remembered as well as the answers to questions 
which sampled the quality of his inferences. Data were obtained on the 
thoroughness, speed, precision, and intelligence shown in exploring the camp. 

Code Aptitude. — It was important to obtain a measure of code aptitude 
which was as nearly valid as that provided by the course of training at 
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Ceylon. It was decided^ therefore, to give what amaiiiUcd to an introductory 
course and use this as the testing situation. The equipment and mediods 
of instruction were the same as those employed in Ceylon. As was men- 
tioned earlier, the recruit spent most of the first .six clays of assessment in 
the code room, at the end of whicli [period a fairly reliable index of ability 
and interest had been obtained, In the event of dt)ubt, there were oppor- 
tunities during the following week for further check.s. In addition to this 
measure of code aptitude, estimations were made of the recruit’s mechanical 
aptitude and his interest in radio equipment, important considerations in 
view of the problems he was likely to encounter in the field. 

Individual Projects.— The students were assigned individual projects at 
the time the program was outlined to them on the first clay. The projects 
consisted simply of constructing something of their own choosing, the 
materials for which the staff would provide if they could be obtained. The 
Karens tended to be specialists in the uses of bamboo— fish traps, bird 
traps, baskets, hats, and so on; the Chinese, in making things of paper, for 
example, drawings, ornaments, paper models. Observation of their efforts 
often yielded significant data on thoroughness, resourcefulness, and initia- 
tive. One recruit, a leader among his colleagues, so cauglit the interest of the 
others that they spent the greater part of their time on his project rather 
than on their own. Since there was ample time for each man to make 
something worth while, failure to do so was often found to be significant. 

Four situations were introduced to provide measures of daring in view 
of the stress placed upon this quality by those in the theater. 

Parachute Jump.— In this test the candidate had \o climb a vertical 
ladder to the top of a tower. There a parachute jacket was strapped 

onto him. Over his head was a inch steel cable which extended on an 
incline toward the ground for a distance of 300 feet. The jacket was attached 
to a pulley riding on this cable, and when the candidate jumped he would 
fall free for a few feet until caught up by the lines to the pulley. Then he 
would coast down the cable until stopped by a pile of rice straw approxi- 
mately 200 feet away. It was an exceedingly rigorous tast which evoked 
marked emotional responses in all candidates. 

Infiltration Course.^This course was constructed in a depression about 
25 feet wide and 100 feet long. The starting point at one end was a slit 
trench built to hold 4 to 6 men. There were several strands of barbed wire 
stretching across the width of the course, under some of which the candh 
dates had to crawl. Shallow crater holes containing explosives were located 
at two points along the course. Sandbags were placed around the edge of 
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each hole, also a double strand of barbed wire to prevent entry. One-eighth 
pound charges of composition explosive were used, covered with dirt to pro- 
vide falling debris. A machine gun in an immovable position was located 
on one bank and was fired across the course into the other bank at a level 
of approxiqiately 8 feet above the ground. The gun was not fired when the 
student was in the line of fire. Observations were made from the gun em- 
placement bank. 

Each student was instructed to climb out of the slit trench on the signal, 
and crawl through the course with his head down. He was told that the 
firing would be 36 inches overhead and that land mines would go off during 
the course, hence not to enter the double wire enclosures. Danger was 
stressed and emphasis placed upon the fact that their safety lay in their 
own hands. 

Weapons Firing. — This test was presented to the recruits as a lesson in 
the use of the carbine and the ,45 caliber automatic pistol, The men were 
observed carefully for evidence of timidity while using the weapons. 
Though it was an exceedingly easy test, it occasionally yielded significant 
information. 

Demolitions.— This test was also conducted as if it were an introductory 
lesson. A brief explanation was given of the method of using TNT and 
plastic, and then under supervision each man prepared a charge and set 
it off himself. The recruit was observed closely during these operations. 
Notes were made of his behavior while he worked with the materials, of the 
amount of nervousness he showed while setting off the charge, and of his 
behavior as he withdrew from the site after the fuse was lighted. Marked 
individual differences were apparent in this situation. 

Obstacle Course — Several tests of daring were included in the Obstacle 
Course, two of which were similar to tests used at Station S. The candidate 
started the course at the base of a tree. First he climbed this tree; then he 
crossed to a second tree by way of the walls of an old building, and from 
there, via parallel ropes, to a large palm, On the palm was a small platform, 
fifteen feet high, from which he swung by means of a series of seven rings 
across to another tree. From there he walked on a shaky catwalk to the 
end, and then down a ramp to the ground. This ended the course. 

The swing on the rings was the most rigorous test of the several, and 
refusals to attempt it were frequent. The course provided, in addition to 
measures of daring, opportunities for observing agility, physical strength, 
and, to some extent, endurance. 

Track Meet ^This was a competitive situation. It provided further meas- 

ures of physical agility and endurance. The following events were included: 
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loo-yard dash, 220-yard dash, broad jump, high jump, baseball throw for 
distance. 

In all these tests of physical fitness, the average performance of the 
recruit was far below that of men in the same age range in the United States 
This difference was largely due to lack of experience in the techniques 
useful in track and field events. But beyond this tltere was little evidence 
of general physical fitness .such ns we were accustomed to sec in the 
States. Although many of these men had been living a fairly vigorous out- 
door life, their arm and leg muscles were weak, and their endurance as 
measured in a race, for example, was low. Some of this frailty can be 
ascribed to years of malnutrition, 

Summary.— Twenty-eight days after the arrival of the first class at Camp I 
Calcutta the last class had departed. The military situation had changed. 
The campaign in Burma was coming to a close and hence recruiting and 
assessment in SEAC were to be discontinued. Requirements for assc.ssment 
in China, however, were pressing, and preparations were started for a move 
to Kunming to join other members of the assessment st.tlf, who were on their 
way from Washington. 

Generalizations cannot be made from the small sample of candidates 
tested at Camp I. SulBce it to say that the lecruits, in terms of hackground 
and race, were very similar to those assessed in Ceylon. Tlutt tlie quality 
had improved over what it had been during the last two mmulis at Camp K 
is indicated by the fact that the rejection rate dropped to 25 per cent. Tlic 
improvement was due, we believe, to the closer liaison that existed between 
the recruiting and assessment units. 

ASSESSMENT IN CHINA 

In February, 1945, a. cable was received in Washington requesting as- 
sessment personnel for a screening program in China. Paratroop commando 
units, formed from the Chinese Army, were to be trained by OSS and 
dropped behind the Japanese lines for combat, sabotage, and intelligence 
operations. They were to_ be led by Chinese olTicers with Americans as 
advisers under a joint Chinese and American strategic plan in connection 
With a forthcoming invasion of the China coast. Assc.ssmcnt was asked to 
help select several thousand troops. 

T ^^*"*^*^**^*^S assessment personnel for this task started immediately, 
ffj oL- States, after a two months’ search, the services of two quali- 
hed Chinese social scientists were obtained. In China, Dr. S. K. Chou, 
Professor of Psychology at the South-Western A,ssociated University, Kun- 
ming, announced his willingness to assist in the program and to recruit 
graduate students if a need for them developed. Two senior memliers of 
the assessment staff m Washington were joined by one senior and one junior 
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member of the Calcutta assessment staff, making a total of four Americans. 
The two Chinese from America participated in assessment at Station S 
while awaiting departure, and when in Kunming were part of a staff which 
finally included six other Chinese: Professor Siegen K. Chou and four 
well-trained graduate students— Mr. Fan Chun, Mr. Ma Chi-wei, Mr. Tien 
Ju-kang, and Mr. Tsao Jih-chang. Mr. Ting Tsan came over from Chung- 
king, and somewhat later Miss Chao Wan-ho, an associate of Mr. Ting’s 
at the National Institute of Health, Chungking, also joined us. 

There were to be new experiences for assessment in China. Kunming, 
in southwest China, was a thriving frontierlike town, overgrown several 
times in size since the loss of coastal China. It was the gateway for supplies 
coming in over the Burma Road and the main air terminus for air-borne 
traffic into China, The Stilwell, or Ledo Road, and the fuel pipe line 
terminated at Kunming. American army units sprawled over the surround- 
ing countryside. Training centers for Chinese troops dotted the side of 
roads, vying with the Chinese peasants for the land of China. Temples 
and schoolhouses, rich men’s compounds and middle-class homes, and 
newly constructed buildings housed Chinese and American military units. 
Amidst this hive of activity, OSS established a training center for China’s 
first parachute jumpers. Large numbers of troops were already in the process 
of commando training. 

The assessment staff was now asked to select men for a replacement 
pool for the commandos already formed, and more urgently to select men 
for two ‘‘intelligence commandos,” men who would not only be good com- 
mandos but would also be able to engage in intelligence activities. (It might 
be pointed out that a “commando” was used to refer to a unit of 135 men, 
as well as to a single soldier.) For two commandos, approximately 250 men 
were required; the officers and noncommissioned officers had already been 
selected. Where could these men be found? Any familiarity with recent 
Chinese events pointed to the difficulty of getting this number of physically 
and intellectually fit Chinese enlisted men. 

The Chinese armies are somewhat unique in modern military annals. 
Hampered by ineffective staff work, and ridden with political appointees in 
high ranks, evolving slowly and showing little evidence of becoming a 
modern army, they struggled on, sometimes against the Japanese, some- 
times merely to exist. Man power was abundant, but of poor quality. There 
were no adequate records kept of personnel. While a draft law existed, 
those with influence, power, or wealth, were able to avoid service. It was 
only the poor and illiterate farm boys who joined the Army, or stayed in 
after they were forcibly conscripted, for the sake of one bowl of rice a day. 
Once In the Army their lot was far from enviable. Runaway inflation 
made their meager salaries seem ludicrous. Medical attention was inade- 
quate; trained doctors and medical supplies were not available in sufficient 
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quantities. Diseases ranging from malaria to scabies were commonplaces. 

It was from this horde of ragged, dispirited, but long-suffering soldiers 
that assessment had to select 250 men suitable for intelligence and com- 
mando operations. 

Official liaison between the American training units and the Chinese 
Army headquarters was generally satisfactory. Ihe Chinese belonging to 
the already formed commando units were receiving excellent training in 
demolitions and combat tactics. Special equipment, extra pay, and the 
facilities usually accorded American military units liad been granted. The 
men were honored in the district since they were the first in China to 
receive instructions in parachute jumping* Grc3t fanfare and excitement 
attended the first jump of the first class trained in Kunming. As the com- 
posite American and Chinese officer cadre jumped out of the planes, a brass 
Lnd played, reviewing generals cheered, and strings of firecrackers popped. 
Pride in the work increased as national iIUc^c^st became manifest, As as- 
sessment was an integral part of the commando program, consideration and 
cooperation were accorded that might otherwise have been difficult to obtain. 

Arriving in Kunming and being informed that several thousand troops 
were available for recruiting, the assessment staff immediately set out to 
visit two pools in the hope of finding a quantity of literate men in reason- 
ably good health. But even after modifying our definitions of ^‘literate” 
and "reasonably good,’* the yield from these pools, and from two other 
pools visited the next day, was disappointing. Few of the men had had an 
education equivalent to that provided by an American primary school, and 
of those who could read, many were disqualified because of inadequate 
vision, poor health, or lack of strength. Since none was free from scabies, 
only those with the severest infestation were disqualified on this count. 
Nevertheless, at the end of two days 550 men who claimed some ability 
to read and appeared to be physically sound had been formed into columns 
and marched to the American training camp. 

The site of the assessment was several miles outside of Kunming on a 
hillside overlooking a great plain of brilliant green paddy fields, There, on 
the edge of a little village full of children, adjacent to the training grounds 
of the parachute school, the assessment staff was allotted several areas. 
Its headquarters were set up in a small country house, which had a garden 
with an unused dirt tennis court and a swimming pool. On the court 
several tents were set up to serve as shelters for interviews and written 
tests; the pool was used for a bridge-building problem. Near by was a 
spacious temple where other tests could be conducted, and farther up the 
hill were two parade grounds and a mess hall available to us at certain 
times. A canyon on the side of one parade ground provided ideal conditions 
for situational tests and an obstacle course. 
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The test program may be divided into two parts: Part One was a onenday 
screening process the purpose of which was to eliminate the illiterate and 
those of distinctly low intelligence; Part Two consisted of one day of 
more exacting procedures designed to test energy, motivation, physical 
ability, leadership, and observational ability among those who had passed 
Part One. 

Part One started in the morning with approximately 120 recruits who 
had just been selected from a larger number on the basis of a one-minute 
reading test. This reading test, conducted on the parade ground immediately 
after the recruits were assembled, was scored as it was given. Those who 
failed were permanently disqualified; those who passed were lined up, 
their names recorded, and an identifying numbered card to be attached 
in plain view to the jacket was issued to each man. After this, one half of 
the candidates were given a battery of tests to determine educational status, 
while the other half received paper-and-pencil intelligence tests. In an hour 
the two groups alternated. This ended the morning session. 

The afternoon was devoted to a continuous round of tests, each of which 
could be administered to a group of 30 men in about forty minutes. In 
this battery were two outdoor group performance tests, several Individual 
performance tests (the “quickies”), and a perception test. On the basis of 
the results obtained during the morning and afternoon sessions another 
elimination of the less suitable men was made. 

Part Two began several days later and was applied to all men who had 
passed the first screening. Again the men were assembled on the parade 
ground and separated into groups of 30. This procedure was not so simple 
as one might expect, because the Chinese officers had no method of keeping 
track of their men. Consequently a portion of the morning period had 
to be spent in eliminating stray soldiers who had never been tested as 
well as those who had been disqualified on Part One but had nevertheless 
rejoined their successful comrades — and in detecting substitutes who had 
been hired to assume the names of recruits who had passed Part One but, 
for one reason or another, had seen fit to quit. These substitutes could be 
identified by their signatures. 

As soon as the bona fide candidates were grouped, a new roster was 
prepared and a numbered jersey issued to each man. While this was in 

process, each staff member attempted a quick over-all evaluation of each 

candidate on the basis of general appearance and reactions to instructions. 
These procedures followed: (i) Interview conducted by one of the Chinese 

members of the staff, or by an American assisted by an interpreter, 

(2) Bridge Building; (3) Obstacle Course; (4) Observation and Memory 
Battery. These, together with the procedures previously listed, are described 
in the succeeding section. 
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The next step in the program was to review the findings and formulate 
a recomniendauion. This was accomplished at a staff meeting where each 
case was discussed, not only in the light of the man’s test scores, but also 
in terms of impressions not susceptible to numerical ratings. The final 
report prepared by the interviewer was an integrated evakuuion of the 
candidate based on all the information available considered in connection 
with his future field operations. 

Several considerations influenced us to adopt a three-point scale instead 
of the six-point scale employed in the States, The majority of the staff 
members were not accustomed to rating traits, particularly in complex 
social situations. And then, at the start of the program, norms had not 
been established for this population, and the concept, for example, of a high, 
average as against a low-average performance was too indefinite to warrant 
making the distinction. Finally, in working with groups as large as these, 
the time spent in observing each candidate was too limited to justify fine 
discriminations. Every rating, therefore, was cither Low, Average, or High. 

In the following paragraphs, the procedures employed are briefly de- 
scribed. As will be noted, they follow the pattern of those used in America, 
with modifications required by the necessity of screening large numbers in 
the shortest possible time. 


Sign Reading. This test was devised to provide a rough measure of 
degree of literacy. Since it could be administered and scored quickly (one 
minute per man), it was used in the first rough screening of ihc recruits 
as they came from the replacement pool. Literacy sufiicient to read a Chinc.se 
classic was, of course, too high a standard to require of simple soldiers, Even 
to demand the ability to read newspapers would have meant the elimination 
of too large a proportion of the men. Therefore a simple test was devised 
consisting of a series of key characters, a knowledge of which did not de- 
pend so much upon formal education as it did upon an acquaintance with 
signs which were part of the daily experience of every soldier. 

Educational Level Battery — Since the purpose of the program was to 
select commandos suitable for intelligence operations, it was decided that 
the men should demonstrate .some ability to count and to write as well 
as the possession of general information indicative of alertness to their 
social and physical surroundings. Each of the three tests was administered 
to groups ranging from 30 to 60 in number. 

AiuTHMETic.^This Consisted of 25 simple calculations presented on a mimeo- 
graphed sheet in both Arabic and Chinese characters. The candidates were 
to write the answers on a separate sheet of paper. 
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WRITING.— This required the filling In of a mimeographed form consisting 
of questions about personal history and interests. Space was provided for 
writing additional information. 

general information.— This consisted of 50 statements, on history, geogra- 
phy, politics, and so on, 27 of which were true and 23 false. The statements 
were read to the recruits, who merely had to Indicate true or false on an 
answer sheet. Fifteen minutes were allowed, 

Abstmet Intelligence Battery.— The tests constituting this battery were 
divided into two parts. Part i consisted of the Series Completion Test and 
the Block Counting Test (Non-Language Test: No. 2a of the Adjutant 
General’s Office), both of which had been employed in Ceylon and India 
Part 2 consisted of three short individual performance tests (the “quickies”): 
(a) a set of photographs which had to be arranged in a series according to 
the age of the subject; (b) a set of pictures which had to be sorted into 
two groups, males in one, females in the other; and (c) a geometrical form 
which had to be duplicated with a set of cards cut in different shapes (as 
in a jigsaw puzzle). One minute was allowed for each solution. The recruit 
was observed and scored as he worked. 

Observation and Memory Battery — Three tests were used in this battery 
as indicators of a man’s suitability for intelligence work. 

DESIGNS.— This measure of the ability to observe and recall accurately was 
also used to test two hypotheses, “Familiar” Chinese characters and sym- 
bols and ^‘unfamiliar” English letters and symbols were drawn on a single 
sheet of white cardboard. This sheet was exposed for two minutes to a group 
of candidates who were then instructed to reproduce as many figures as 
they could recall, A slight imperfection (error or broken line) had been 
introduced in drawing each figure. The two hypotheses were these: (i) that 
the candidates would remember more of the familiar than of the unfamiliar 
figures, and (2) that they would overlook imperfections in the familiar 
figures more often than they would overlook them in the unfamiliar figures. 
The results will be discussed later. 

SEARCH.— This was similar to the Belongings Test in the program at Sta- 
tion S. The story invented for it was that of a Chinese captain who ha 
been forced by the weather to camp in this place with his troops for the 
night. On departure he had left some of his possessions behind in the ad- 
joining tent. The candidates, individually or in small groups, inspected the 
tent and after two minutes returned to the examiner, who asked them. 
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What have you seen in the tent? Who was tlie ca[nain who stayed in the 
tent? Why did he choose to stop in this place? 

PERCEPTUAL ACUITY— This tcst nicasiucd speed and s[ian of perception 
Each figure was presented tachistosco[iically at i/io secotui by a 35 mm' 
projector. The figures presented were a row of liorizomal dots (from 3 
to 7), Arabic digits, simple geometric figures, simple figures with a small 
gap somewhere in their contour, and so on. I'he men were required after 
each exposure to draw the figure seen. Tliis test was designed in Washing- 
ton and included in the battery chiefly for experimcntitl purposes. 

Group Practics Bauei7.— These tests, three in number, were important 
for the data they provided on Effective Intelligence, Energy, Motivation, 
Cooperativeness, Physical Ability, and, to a certain extent, Daring. They 
corresponded, except in detail, to group field situations as used at other 
stations. 

BRIDGE BUILDING.— This rcquircd the construction of a bridge across the 
27-foot width of the swimming pool. The recruits, ten at a time, were 
expected to complete this task in forty-five minutes. Tliey were told to 
assume that the pool, which was full of water, was a river and therefore 
it was not possible to walk around it to the other side. Furthermore, the job 
had to be done without anyone wetting his feet. 'I'wo logs, 23 and 9 feet 

in length, heavy rope, planks, stakes, a sledge, and a pick were the materials 
provided. 

flag pole.— This called for the transportation of a long heavy log across a 
deep canyon by a group of ten men. The task called for energy and team- 
work, and so provided a good op^xirtunity to observe Leadership, Motiva- 
Cion, and Social Relations. ^ 


RAVINE. This involved the construction of a rope bridge across a canyon, 
two groups working cooperatively, one on each side of the canyon. After the 
)ob was finished the examiner called for volunteers to cro.ss the hriclLre. This 
was considered to be a measure of daring. 

Obstacle Course.--Tlus was constructed in a ravine located next to one 
le para e poun s. The obstacles were arranged in a series in such a way 
as to require the recruit to cross back and forth over the stream as he worked 
his way up the canyon. The first obstacle was a log resting on die floor of 

k ^ 30-clegree angle against the top of the bank. This 

nad to be climbed to reach a horizontal rope stretching for 40 feet below 
the crest of the bank. Along this rope, hand over hand, the candidate would 
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then make his way along the almost vertical wall. Here and there he could 
find some support for his feet. At the end he descended to the bottom via a 
vertical rope. Next was a 5-foot hurdle in the middle of the stream which he 
climbed to reach an 8-foot platform on the other side of the bank. From this 
elevation he jumped back across the stream and then recrossed once more 
on a horizontal log 10 feet above the water. This brought him to the last 
obstacle, a pair of parallel ropes suspended between trees 20 feet above the 
floor of the ravine. He reached these by a rope ladder, and with feet on the 
lower rope and hands on the upper, he worked his way over to the far side. 
When he reached the ground the course was completed. 

The men were started one at a time at three-minute intervals. This course, 
easily viewed and scored from the top of the ravine, provided measures of 
daring, agility, and endurance. 

Interview.— Most of the interviews were conducted by two Chinese psy- 
chologists and by an American assisted by an interpreter. The interview 
was necessarily short, from five to fifteen minutes, but it was nevertheless 
important in view of its being the only face-to-face situation in the program. 
Frequently it was the deciding factor in settling the fate of recruits whose 
test scores were on the border line. Special emphasis was placed on the de- 
termination of Motivation and Emotional Stability, Ratings were made on 
all traits, however, and notes were taken on significant features of the man’s 
past history and present attitudes. The method of interrogation, although 
subject to variations from interviewer to interviewer, was essentially the 
same as that used at other stations. 

General Impression. — This was undertaken as an amusing experiment 
to see how well the staff could predict the final over-all rating of each recruit 
on the basis of a few seconds of observation. When the recruits were lined 
up in the morning preparatory to engaging in the test procedures, each senior 
staff member rated each recruit as he stood in line. Usually at the moment 
the judgment was made the recruit was putting on a numbered jersey that 
had just been issued to him. 

The following variables were rated (Low, Average, or High) on the final 

report form r . , r 1 o 

Educational Level, based on Sign Reading and Educational Level 

If the case was on the border line between two grades, the quality of hand- 
writing, a talent highly esteemed among Chinese, was taken into account. 

Effective Intelligence, based on Interview, Abstract Intelligence Battery, 
Observation and Memory Battery, and Group Practics, 

Observation and Memory, based on the battery of three tcsts-Perccptual 

Acuity, Design, and Search. 
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Motivation, Social Relations, and Emotional Stahilityt three separate varia- 
bles, each based on the Interview, Group Practics, and Obstacle Course. 
Leadership, based on Group Practics. 

Physical Ability, based on Obstacle Cc)iirse and Group Practics. 

'FABLE 21 

Correspondence of tho Procedures witli the Final Ov^r^All Rating at Kunming 


Test 


Interview 

Sign Reading 

Educational Level Battery 

Group Practics Battery 

Observation and Memory Battery 

General Impression 

Abstract Intelligence Battery, . , . 
Obstacle Course 


Since the final over-all rating was arrived at after an examination and dis- 
cussion of the ratings on the separate procedures, it would he extraordinary 
if one found anything other than what is indicated in this table, namely, a 
rather high correlation between the test results and the final estimate of suita- 
bility. In the majority of cases the final rating was merely the average of all 
the other ratings. 

The rank order of the different procedures as shown in Table 21 cannot 
be accepted as definite evidence of their relative merit, since a number of 
factors, some subjective and some fortuitous, were influential in determining 
the result. The Interview was clearly first, not only because this was a very 
revealing procedure, but because past experience had persuaded the staff that 
considerable reliance could be placed on an interviewer^s judgment and also 
because the staff member who interviewed a candidate usually attained a 
greater degree of confidence in his ratings than that attained, let us say, by 
the staff member who observed him on the Obstacle Course, Consequently 
in the discussion of each case the interviewer was likely to be the one who 
argued with greatest conviction and was listened to with most re.spcct. 

Sign Reading stands high on the list because everyone who received a low 
rating on this test was automatically disqualified (i.e., received a low over-all 
rating). Of the seven ratings which appeared on the summary sheet pre- 
sented to each staff member at the final discussion, four (Abstract Intelli- 
gence Battery, Educational Level Battery, Observation and Memory Battery, 
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and Sign Reading) were estimates, direct or indirect, of cognitive functions. 
Furthermore, the interviewer was very likely to be influenced favorably by 
evidences of intellectual power. Consequently the average of the seven ratings 
was more representative of the candidate’s intelligence level than it was of 
his physical energy, motivation, courage, leadership, team spirit, and so forth, 
which were covered by only two ratings on the summary sheet. This largely 
accounts for the fact that the Group Practics Battery and the Obstacle Course 
stand relatively low in the rank order. In this connection another point is 
perhaps worth mentioning: Chinese generally, and Chinese scholars (e.g., 
psychologists) especially, are inclined to value the intellect, even within the 
sphere of military enterprise, more than we Americans do. This helps to 
explain why the staff members, most of whom were Chinese, were usually 
more impressed by a high rating on the Educational Level Battery, for ex- 
ample, than by a high rating on the Obstacle Course. 

The intercorrelations among the different procedures were relatively high 
compared to those found when comparable tests have been administered to 
American groups of similar age. This relationship probably means that some 
underlying general factor, such as motivational energy, was the chief deter- 
minant of excellence on all the tests in which the Chinese reciuits engaged. 
According to this hypothesis the possession of a high degree of motivational 
energy (ambition) makes a boy more alert, and prompts him to exert him- 
self not only at home, helping on the farm, but also at school; and as a 
result he will forge ahead of the more complacent majority in most lines of 
activity. In America, however, specialization begins earlier and is more wide- 
spread. A boy finds that he excels in athletics, or at mechanics, or in English 
composition, and before long we find that most of his eneigies are being 
canalized in this direction and in one or two others. Thus at twenty-five 
he has probably suceeded in developing himself beyond the average in 
certain abilities, but has fallen behind in others. 

The relatively high correlation of General Impressions with final ratings 
is interesting, particularly since the scores on the former were not taken into 
account in deciding the latter. Fifty-eight per cent of the average of the staff 
impressions agreed exactly with the final ratings. The best estimates were 
made by one of the Chinese psychologists, and the next to the lowest by 
another. There was no appreciable difference between the averages of the 

American and the Chinese raters’ scores. _ 

In breaking clown the scores on Designs into two parts, Chinese designs 
and American designs, it was found, in conformity with our hypot esis, 
that familiar Chinese symbols rather than unfamiliar American symbols 
were recalled better by the Chinese. Of the total number of correct responses, 
68 per cent were to Chinese characters or symbols, and 32 per cent were to 
American. But the hypothesis that familiarity with the symbols would inter- 
fere with the observation of slight errors and omissions was not supported 
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by the results. Instead of there being more incorrectly reproduced familiar 
designs (with the errors in pattern overlooked) there were more incorrectly 
reproduced unfamiliar designs. The figures were not presented tachistoscopi- 
cally, however, and it is possible that the recruits, with two minutes to study 
the ptteriis, may even have been aided in the recall of the familiar by the 
special emphasis that these errors and omissions produced, Exjx)surcs of 
short duration might yield results to support the original hypotlicsis, 

Just before the dropping of the first atomic bomlo and the subsequent end 
of hostilities, it was decided that assessment in China sluuild discontinue. 
Eight hundred men had been processed, 220 of them more intensively than 
the rest. Although the staff was prepared to assess more groups, suitable re- 
cruits wcie not to be found. Apparently there was nothing left to be done in 
the Kunming area. 

Shortly before our departure, however, one more opportunity to get into 
action presented itself; the staff was asked by a Chinese general to give a 
demonstration of its methods by assessing n group of C.hincse Army Officers. 

Assessment of Chinese Army OfFicers,— Heretofore assessment had oper- 
ated under American auspices; now it was to l>c conducted in a wholly 
Chinese setting. Among the numerous agreeable discoveries to be made was 
the fact that convivial tea drinking, poetical wine toasting, and fine feasting 
were integral parts of the process of setting up a screening program. It was 
natural to engage in social activities of this hearty sort with considerable en- 
joyment and gusto, and within a day or two the Americans felt very much 
at home and in a mood to compromise on any issues that might arise. Al- 
though every step called for a sequence of courteous negotiations, in a few 
days all necessary materials and equipment were assembled, an obstacle 
course was constructed, and a schedule of procedures was arranged, several 
of which had to be improvised on the spot. The General, exceedingly cordial 
at all times, evidenced considerable interest in all our proceedings, and did 
everything in his power to facilitate preparations. 

The group selected for processing consisted of thirty junior grade officers 
from various units, who had been transferred to main headquarters for a 
special training program under the General’s supervision. Some of the men 
had engaged in combat in Burma; some had participated in ‘"bandit suppres- 
sion expeditions before the Si no- Japanese War. They were all literate; the 
majority had had a junior high school education, and several were military 
academy graduates. Their motivation for the program was excellent, the 
General having exhorted them to cooperate to the limit. He was there to 
observe them during the whole program. 

Pour one-story-high school buildings, forming a square compound with a 
large court in the middle, were put at the disposal of assessment. Situated in 
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the middle of a village about two miles from Kunming and close to the 
headquarters of the Fifth Chinese Army, the facilities left nothing to be 
desired, Across the road from the school compound a stream flowing swiftly 
between steep banks, provided ideal conditions for a bridge-building prob- 
lem, A balf-built house near by was available for an obstacle course. Assess- 
ment does not depend upon a definite set of materials or conditions; the 
program can almost always be adapted in one way or another to local condi- 
tions. For instance, if, because of scarcity of materials in China, poles cannot 
be cut to size but must be borrowed and returned intact, then the problem 
becomes one of finding a spot that will fit the poles instead of the more usual 
one of fitting poles to a chosen spot. 

There was no need for undue haste; only thirty men had to be assessed. 
Furthermore, wc were not asked to decide the fate of each assessee, to accept 
or reject him. The program was designed merely to demonstrate our system 
of assessment to the Chinese General and other interested officers. 

The staff remained unchanged except for the loss of two Americans who 
had left for Hsian, North China. It was augmented by the addition of three 
more Chinese graduate students and two experienced Chinese psychologists. 
These new members, three of whom were women, were eager to see assess- 
ment in operation. 

Three series of tests were scheduled, A, R, and C, each of which lasted half 
a day. Series A, which took place indoors, consisted in filling out personal 
history forms and performing a variety of paper-and-pencil tests. Series B 
included outdoor field situations, individual and group, and an obstacle 
course. Series C was a sequence of indoor group procedures. The assessees 
were divided into three subgroups (I, II, and III) of ten men each. While 
Group I was taking Series A, Group II was engaged in Series B, and so forth. 
The three groups completed the three series in a day and a half. The inter- 
views took place a few days later, after all tests had been scored and a 
preliminary sketch of each personality composed. As most of the procedures 
have already been described, a very brief account of them is all that is re- 
quired here. 

Personal Data Slicet.--This was an abbreviated and slightly modified 
form of the sheet used at Station S. 

Sentence Completion.-- Fifty of the phrases used at Station S were 
translated into Chinese with minor changes. Mimeographed sheets were pre- 
sented to ten men (one subgroup) at a time. 

Modified Thematic Apperception Test.-Ten pictures, carefully se- 
lected from Chinese magazines, were divided into two sets, A and B, of 
five pictures each. While five of the candidates, seated round a table, were 
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occupied with Set A, the other five at another table were busy with Set B 
Each candidate was given one of the five pictures placed on his table and 
told to write a dramatic story in seven minutes for which the picture might 
be used as an illustration. When time was called, each man was instructed 
to pass his picture to the man sitting at his right. Thus in thirty-five minutes 
every candidate had written five stories. After an intervening test of another 
type, the two set.s were exchanged and each man wrote five more stories. 

This method of administration proved very successful. The stories, taken 
in conjunction with the responses to the Sentence Completion, yielded a 
great deal of pertinent information. 

Scries Completion and Cube Counting.-These were the same as those 
used in the assessment o£ commandos. 


Designs — The same test as that used in commando assessment. 

Improvisations — As at Station S, the asscssccs Ixdonginir to one subgroup 
werc^taken in pairs, the members of eacli pair being told that they must 
imagine themselves involved in a certain situation (clearly described to them 
y the examiner) and that they must act as they would in everyday life. In 
accordance with these instructions, five different episodes (one by each pair) 
were enacted in front of the staff and the other members of the subgroup, 
vc minutes being allotted to each episode, The situations chosen were close 
tot eexpeiieiicc of these officers; they were not designed to check any .special 
tentative formulation of each asscssce’s personality. The same five situations 
Were used for all three subgroups. 

Speech. Each man made a three-minute speech before his subgroup on 
a topic of his own selection. This procedure conformed to the traditional 
Chinese assumption that a leader must be a good public speaker. 

Discussion.— “Relaticms between the Army and Civilians” was assigned 
as tie topic foi an impromptu discu.ssion among the ten members of each 
su group gathered around a table. Since there was a good deal of friction at 
tie time between .soldiers and civilians, this topic wa.s both timely and pro- 
vocative of emotion. 

Bridge Building._Tcn men were assigned the task of building a bridge 
across a is-foot stream with banks lo feet high, The problem was basically 

tlie same as that presented in commando assessment. This was called “group 
Dractics. ° ^ 


bstacle Course. A half-built two-story house with rafters exposed, no 
Hoors laid, windows open, and roof unfinished served as a frame for the 
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obstacle course. All that was needed was plenty o£ rope for climbing and 
swinging. Agility, daring, and strength could be readily estimated by the 
observers. 

Assigned Leadership, — Five outdoor situations, “critical emergencies,’’ 
were invented, each at a different spot out of sight of the others; and every 
assessee was given five minutes to show how well he could direct the activities 
of a squad of four men in solving one of these situations. For this purpose 
each subgroup was divided into two squads of five men. Squad A started 
at the site of the first problem; Squad B at the site of the third, From then 
on the problems were taken in order, at each site a different man being se- 
lected to act as leader. 

Individual Practics.— Six low stone pylons (supposedly the remains of a 
blown bridge) placed at irregular intervals on the ground (the bed of an 
imaginary river) constituted the only supports for a bridge of planks and 
ropes which had to be constructed from one bank to the other in three 
minutes. 

Sociomctric — The form used at Station S was distributed to all the 
assessccs at the end of the testing period, Since these men were members of 
a training class which had been living, working, and studying together for 
several months, everyone had had ample opportunity to observe the behavior 
of the others and so acquire sufTicicnt basis for judgments of leadership traits 
and potentialities. Because of our ignorance of the standards that prevailed 
in the Chinese Army, the findings on this test were heavily weighted when 
we arrived at our final conclusions. 

Interview.— *A few days after all the other procedures had been completed 
and the results analy/xd and synthesized, each assessee was given an inter- 
view lasting from one and a half to two and a half hours. The advantage of 
this timing was that the interviewers had a good deal of information at their 
disposal to guide them to certain critical areas of each man’s personality 
which reciuirecl further exploration. 

The re[)ort vshects used in this study were the same as those which had 
proved useful in commando assessment. There was the same list of variables 
rated Low, Medium, or High, and a typewritten personality sketch of the 
assessee (averaging two thirds of a page in length) written by the inter- 
viewer. In this final note an opinion was ventured as to the best use that 
could be made of the oiTicer in question, whether, for example, he was better 
fitted for combat or for staff work. 

Since the war came to an end a few days after the completion of the assess- 
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ment period, there was no opportunity to evaluate the accuracy of our iudtr- 
ments. We never learned wlictlier any of the assessccs eventually cneaued 
in combat against the Communists in the North. In the two weeks devoted to 
the enterprise we had added to our fund of knowledge a.s well as to our fund 
of inteniiely enjoyed e.\pericnccs, and the General seemcil plca.sed with what 
he had seen of the proceedings. This was the height of our expectations. The 
Chinese members of the staff had been astonishingly quick in grasping our 
methods and in learning to function effectively in a somewhat complicated 
schedule of procedures. To them belongs the hulk of the credit for the 
measure of success that wavS achieved. 

An unfortuna^ sequel of the assessment process is not without interest, 
ur friend the General called together his heackiuarter.s staff, his training 
staff, and the thirty men who had been tested and piililicly read each assess’- 
ment report with the man under discussion standing at attention in front of 
hea.ssembled group. Following each reading, the General lectured or praised 

imprison at 
■acter,” and 


, — , ° 1 b i-uc lectured 

the olheer, depending on the content of the report, and .saw fit to i 
least one man in a dungeon “to reflect upon his bad moral chan 
rectify himself." 

ASSESSMENT IN HSIAN 

In response to a request from the Iiuclligence Branch of OSS a special 
assessment project in Shensi Province, near the Yellow River Bend, was 
. heduled. This was to include, first, an evaluation of a group of forty 
0 fifty Koreans who had been in training for several months under the 

officer personnel. Then on comply 
a JO , It was planned to .select additional nurnhers from scattered 
groups of Korean.s who had escaped from the Japanese Army. They were 
located in villages in one of the Chinese-controlled pockets in Central China. 

ccor ing to pan the men selected would enter Korea with radio equip- 
ment by any means available for the purpose of reporting upon current 
Japanese trMp movenients, local conditions, and .so forth. In view of the 

Srn? I ^ courageous, and 

ber"anB f ‘"'m of one senior and one junior staff incm- 

cultivation and truining camp were under intensive 

na ve ^ program. As an alter- 

of ihe ^ mountain country which rose abruptly out 

vaTev bVn Z^r^^ 5 m' ^com the 

Ireala^^a H surrounding 

vided place to cook and to conduct interviews and written tests, and had, 
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in addition, several rooms with bunks of stone and mud on which to sleep. 
There were other reasons, besides the camping facilities, for choosing this lo- 
cation. The stall would have the opportunity of living with the men and so 
of observing them under conditions that would not have been possible at the 
main camp. Conditions for living were relatively crude and not altogether 
comfortable. Except for one meal provided by the candidates, the food con- 
sisted of K rations, the beds were of stone, illumination at night was by 
candle, and wood was scarce. Sanitary facilities had to be constructed. 

It was arranged to have a truck bring the candidates in the early morning 
as far as the foot of the hill and return for them on the evening of the second 
day. The candidates carried the necessary supplies up the hill on their 
shoulders. 

After unpacking personal equipment, stowing supplies, and digging 
latrines, the candidates were ready to begin. Since the program followed the 
pattern of those previously discussed, except for a few modifications re- 
quired by the conditions of this location, a detailed description is not neces- 
sary. More than any earlier program, this one was handicapped by a short- 
age of trained personnel. Although the three interpreters had undergone 
screening at Station S, they were not familiar with the purposes of the tests 
they had taken. The presence of the senior staff member was therefore 
required tor the administration and observation of most of the procedures. 

The Interviews, therefore, were scheduled during evening hours or at 
times when the written tests were being held. Interviewing was expedited 
to some extent by the use of the Personal HisStory Form and the Sentence 
Completion Test, the replies to both having been translated into English 
prior to the Interview. The Interview situation was important, particularly 
in view of the low motivation of these recruits for the type of work for 
which they were being trained. It was the one situation which would sample 
their attitudes on this point, and it seems to have been their first opportunity 
to express their fears. 

Of the written exercises, the Personal History Form and the Sentence 
Completion Test were given first in order to permit the Interviews to start 
as early as possible. Following these, the Kunming battery of nonlanguage 
written tests, the Progressive Matrices, and the Pistol Assembly Test were 
given. Since these candidates had been selected because of having had 
superior education, performance, particularly on tests of abstract intelligence, 
was high in terms of norms for the Far East. 

Toward the end of the afternoon of the first day preparations for sup- 
per were started. This situation was, to all appearances, merely a matter of 
providing one hot meal for staff and candidates. On the previous day the 
latter had been given several thousand dollars (Chinese national cur- 
rency) with which to purchase the necessary ingredients. What they pu^ 
chased was left to their discretion. As it turned out, the staff was serve 
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noodles and cluclccn with melon for dessert by four successive chsses V k 
group earned up a wicker basket enntairring three or burr irat ctk. 
whrch was placed with other supplies at the feet of Burldha, At su^rtW 
he chickens were drspatclrcd, clea.u-d, dressed, and immediately ihZT T 
the pot. Barely were they heated when they were being served to us i rl 
noodles. The mixture was savory despite the sinewy mea ft h! 
seasoning and some accidental additioii gave a llavor diat wls unit uc 

Fcp^'ration of this meal were limited: a 
ripr f ^!k a pot for the cofTcc, and a sciuare GI water car 

Tier for the remainder were all that were provided. This limitation on eon' ' 
ment added both to the problems and to the interest. AlthouLdi th 
was simple, teamwork and planning were necessary to produce k' and m 
M da« usually durine >l,k l,„„r and a hilf „£ ai ’ 

Tka mfomal atmosphere belied the (act that this was a test ‘ '' 

following (dinner, interviews svere continued until apnroximitelv i.n ■ 
le evening. At that time the recruits were called toirethcr for -i tr^ !•'' 
cuss, on. This session, held by candlelight, was etmdited in the tt"7„ t 
but proved to be more productive than it liad liecn with the Cliincie Tl!.' 

K"^;:„r.Tdr7r7i;re:f'' 

viewrr-e.LTera.IhJr ite "f' 

given. For the htrep nc m p 1 ^ ^ ^ demolition lest was 

tions wem^cJrLVforlunTh^^^^ ^ ra- 

wereyrin^the wafel there 

tis in KuLn^lTtir r '"^^tmetions 

t^unmmg. Later the Cl, If Scaling problem was iturcclucccl. 

c?nLam/r^tanke°c!ir ff" ^^^“tig^tt the 

floor of the canyon. Workfa^LomT' "PP^^'tnntely thirty feet from the 
vise a safe means for ib ^ 'j required to de- 

provided wirrope but wl^^^ ^^tittom. They were 

it with them after 'the last m ° b i would be necessary to carry 

attempt the descent and therf r escended. No one was forced to 
P ciescent and there were frequent refusals. When the group had 
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completed the construction, some were unwilling both to descend and to 
ascend. This test provided additional measures of the same traits as revealed 
in Bridge Construction, but it yielded in addition another measure of daring, 

Wcnpons Xcst* The Weapons Test followed Cliff Scaling at a point on 
the trail where there was a suitable range. As in Calcutta, it was not given 
to provide a measure of markmanship, but as an opportunity to observe any 
indications of timidity in the use of weapons, a mild but, nevertheless, fre- 
quently revealing test. 

Following this, the group started back to camp. This completed the test 
program. The men packed their equipment, policed the area, and departed 
in time to meet the truck in the valley below at five o’clock, 

Summary of Results.— -As is evident from Table 22, the number of men 
who were not qualified for agent work was large. In addition to the fact 
that the standards for qualifications were high, the motivation of most of 
the men for agent work in Korea was low. Many of the recruits had 
deserted from the Japanese Army and were reluctant to expose themselves 
to the danger of recapture. Their lack of drive and resolution had not been 
communicated to their Korean officers at Eagle Camp. To have admitted 
their fears would probably have involved the loss of *‘face ” 

TABLE 22 

Summary of Results of the Hsian Assessment Project 




Reasons for failure 

Passed 

Failed 

Motivation 

Emotional 

1 Effective 




Stability 

Intelligence 

ZX 

19 

10 

6 

3 


But the Interview, which was specifically directed toward the assessment of 
this disposition, was for them an easily accepted invitation to express their 
worries. Although in many cases they would not admit anxiety, they often 
called attention to some physical disability or weakness which they believed 
would preclude work in the field, despite the fact that these disabilities were 
not noticeable in the group tests or on the mountain climb, both of which 
required physical strength and endurance. 

On the other hand, motivation in these men was high for work in the 
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Ko ean postwar government. Ihere was a general appreciation of the fact 
that they, a.s selected personnel of the Korean Independence Army nj 
closely associated with the Korean Provisional Government wo iW ^ 
opporamities in that field at the enti of the war. In a large (icrccntiK of h' 
cases interest did not extend much beyond this; patriotiL, defined Is ! 
willingness to sacrifice one s life for one’s country, was all but absent 
In seeking an explanation for this, it was observed that low motivation 
W.S £., mo,= pre„l0M among aolkga graJnalca than among „„„ „ 
mcn^Sevaml comlatad factors were i„vol,c<l. Those who Irad been al 
to afford a college education came from Korean families who had t 
gneral, „.r fared badly under Japanese ruler several „f the reeruits S' , 
teuded umversmes ,n Japan. Tl.ose who h.ad not been to college, Tthe 

h d wS' W'tt'ttly from fatnilies to whom the lapaneto 

ot found it necessary to make concessions, were members nf ’ 

la'^nanese'^ '"^'d felt more sharply the discriminations made in favorTf 
S, h.T/rr " J^'Pnnese domino 

ather than an intcl ectual appreciation of the advantages of freedom was 
the primary factor determining tlieir willingness to face danger. 

ffecting the motivation of the whole group ivas the fact that none of 
diese men had ever lived in Korea when it was not Japanese<lominatcd 

Jtl 71?”" V 'vL a very "ague 

to lose by Japan’s defLl" stood 

COMMENTS 

In surveying the work of assessment in the Fir Fn^r if coovv, • i 

assessmenr ^ ^ for this is straightforward: if the 

:m;:e“Sri:FF”£’"- 

we asLme^^tW Tc ^ important implications. If 

have been found toToTd test, the rules which 

tests as selection devices shoid^be ' ^ tests or special aptitude 
whole. The Darticnlnr rni T.* u • "PP screening process as a 

of aSvenSr' ■“ *e .eleeeieo 

e her of men by means of a tesi possessing a fairly high validity, 



Assessment Overseas 39] 

tk mtst dility of tliosc finally selected will imist as the size of the 
sample tcsictl iiicicascs. And as a corollary to this; the probability of error 
ill the selection process decreases with an increase in the size of the smple 
tested. Futthetniote, a test of low validity may still be useful if the sample 
from which selections arc made is larje, Thtse statistical rules, so pertinent 
to the recruiting policy of an organization, are too frequently overlooked 
Recruiting for any organization should he as active as is consistent with 
the resources of the assessment unit, in terms of funds and personnel, Much 
can he done by an assessment unit to accommodate itself to volume without 
a great inciease in operating costs, For example, coarse screening tests can 
be administered which will immediately eliminate recruits who do not 
possess the minimum rquired ability in some important specific variable. 
This technique was employed in China, where ability to read was an essen- 
tial qualification. There the number of men initially brought in from 
near-by holding areas was well over a tliousand. By simply asking those 
who could read to step forward, the first step in screening was accomplished. 
This reduced the group to less than half its original size. Then by a one- 
minute, objectively scored reading test the number of candidates was still 
further reduced. Only those who remained took part in the more elabate 
and expensive per, tonality assessment procedures. 



Chapter IX 

THE EVALUATION OF ASSESSMENT 


From the momeat ihaL wartime acccsssity laid upon the assessment pro- 
gram the responsibility for making many decisive judgments, an objective 
and disinterested appraisal of their validity became essential. In che short 
time devoted to each candidate it was hard enough to sketch the broad 
outlines of a satisfying and meaningful formulation of his personality. 
Predicting his future behavior under largely unknown circumstances was 
more challenging. But still more dilTiciilt was the task of making an ade- 
quate and impartial evaluation of the degree of success of these first two 
undertakings of assessment. Because OSS urgently needed personnel to 
carry out its operations, In the early months of the work all energies had to 
be turned to the pressing requirements of selection; appraisal of the effi- 
ciency of the process had to be postponed. When at lust it was possible to 
establish a comprehensive program of validation procedures, the unex- 
pectedly rapid end of the war cut it short. These unfavoral)lc circumstances 
added tremendously to the difficulty of our basic task: that of establishing 
satisfactory criteria by which to measure accuracy either of diagnoses of 
personality or of prognoses of performance in a specific assignment. 

These complexities bulked so large that we were unable to overcome them 
all. Although thousands of man-hours were spent in the evaluation process, 
the final verdict is a question mark. Nearly all the members of the staff 
and many of their colleagues in OSS who observed the operation of the 
program had the strong impression that, by and large, the administration 
had been furnished with meaningful descriptions of the traits and abilities 
of the recruits, which were of considerable service in winnowing the wheat 
from the chaff and in placing the wheat where it belonged. But how val- 
uable is an impression? It was the need for certainty, the compulsion 
which motivates all scientists, which prompted us to embark on an extensive 
program to check the ratings and recommendations of assessment. Un- 
happily the final result was a decrease, rather than an increase, in degree 
of certainty — a temporarily discomforting, but, in the long run, often pro- 
ductive state of mind. 

Our uncertainty stems from the conjunction of three facts: first, that our 
final over-all correlations between assessment ratings and appraisal ratings 
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are of a low order, a result which proves that errors of considerable magni- 
tude entered into the assessment process, or into the appraisal process, or 
into both. Second, that the appraisal process was carried out with much less 
regard to scientific principles than was the assessment process, and so we 
can hardly avoid the conclusion that a large proportion of the discrepancies 
between assessment and appraisal is the result of defects in the latter rather 
than of defects in the former. Third, that an analysis of the circumstances 
at home and overseas reveals that if assessment had operated perfectly, 
adhering closely to scientific principles, an appreciable number of predictive 
“errors" would necessarily and quite properly have been made. Furthermore, 
that, under the .special conditions existing in the OSS, an additional number 
of predictive “errors” was inevitable, even if the assessment staff had been 
correct in every one of its judgments. This is a matter which will be dis- 
cussed in the next chapter. Here it is sufficient to explain that it is our 
ignorance of the minimal percentage of these inevitable “errors” which 
makes it impossible for us to calculate the percentage of true errors that 
resulted from our own deficiencies in technique and clinical judgment. 

The negative statistical outcome would probably have deterred us from 
the huge labor of this book if it had .shaken our faith in the general prin- 
ciples underlying the OSS system of assessment and if we had not firmly 
believed that we had succeeded in distinguishing most of the defects in our 
implementation of the system. Anyhow, it is clear that the picture presented 
in this volume is not that of a noble building ready for occupancy, but rather 
of a mass of rubble with many good blocks of granite and marble out of 
which a substantial edifice can be erected in the future. This chapter, with 
its emphasis upon our errors, may prove more useful than any other in the 
book, especially if the reader pays close attention to the defects in our 
validation procedures and employs his imagination in thinking of ways to 
rectify them. 

Although the situation which confronted the OSS assessment staff was, in 
many respects, unique, yet many of the difficulties we encountered are com- 
mon to all undertakings of this sort. A discussion of our handicaps and mis- 
takes, therefore, should serve to clarify some of the problems of future 
workers in this field. 

HINDRANCES TO THE EVALUATION OF ASSESSMENT 

First, there were the difficulties which stemmed from the assessment 
situation itself. These have been fully described in Chapter I. At this point 
we have only to take note of the fact that since the job analyses and environ- 
ment analyses were unavoidably inadequate for assessment purposes, our 
conceptions of the different roles were extremely vague. Consequently, in 
assessing each candidate we had nothing specific in mind with which to 
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compare his performances. If wc ended by recommending him for his 
proposed assignment, it was because we thoiiglit that he had qualities which 
would enable him to cope with most situations, as wc dimly imagined 
them, in the designated field of activity- -administrative work, gathering 
intelligence, field operations, and so forth. Hut, actually, the assessed man 
who went overseas was not called upon to deal fairly well with a multiplicity 
of rather general situations, but to deal very well with a limited number of 
specific situations. In other words, the assessment stalls rated candidates 
according to their conceptions of a scale of all-round men in a given field 
of activity, but these men were appraised in the theater according to how 
effectively they performed a particular role in a particular location. Thus 
some of the discrepancies between assessment ratings and appraisal ratings 
may be attributed to the difference between the two frames of references- 
genemhty of ability and specificity of alfility. Other discrc[)ancics may be 
ascribed to the fact that many candidates were assessed in compari.son with 
necessarily inaccurate conceptions of their roles. 

Another factor, mentioned in Cha[)ter I, to which some discrepancies 
betweea assessment ratings and appraisal ratings can be attributed was 
die very frequent occurrence of un[)rc(licuil)lc changes in the jobs and in the 
environments to which men were assigned in the theater. Theoretically, 
the whole process of validation becomes meaningless under these circum- 
stancest if assessment, in obedience to its directive, had rated each man 
according to his suitability for a particular assignment, the validity of this 
rating cannot be determined by comparing it to the rating received for 
effectiveness in a different assignment. But, as pointed out above, although 
we held some conception of the assignment in mind while rating each 
candidate, we knew not only that this conception was defective but that 
the man was likely to be given a different assignment in the theater; con- 
sequently, the notion of an all-round OSS man was probably more influen- 
tial as a standard for comparison than any precise formulation of job 
Eunctions. Thus the standard, in most case,s, was not specific and yet not en- 
tirely general. As we shall see, the correspondence of assessment and ap- 
praisal ratings is closer in the case of men who undertook the missions 
originally proposed for them than It was in the case of men who were given 
entirely different missions on arriving overseas. 

Another source of error, not yet discussed, was differences heiwcen the 
Erames of reference employed at assessment and tho.se employed in the 
theater. At Station S, for example, the variables were rated, not entirely in 
terms o overt manlfestation.s, but partly in reference to repressed tenden- 
cies anc to t eir relations with other variables. We did this despite the fact 
t at It was certain that our conclusions would not jibe with the impressions 
ot many people who knew the candidates only superficially. We knew also 
that the men would display different facets of their characters to different 
observers and, as a result, the ratings we obtained from these observers 
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(informants) would not agree with each other; and, if they did not agree 
with each other, they would not all agree with us. We believed, however, 
that ratings of the traits based on a dynamic formulation of the whole 
personality would generally agree more closely with the impressions gained 
by otlier observers than these impressions would agree with each other, 

Another difficulty involving frame of reference, which affected chiefly 
the validation of job-fitness predictions, was due to an ambiguity in the 
thinking of the assessment staff that was never wholly rectified. In giving 
job-fitness ratings consistency requires that an excellent cook be given as 
high a rating as an excellent general. But this is difficult to do in a program 
in which both Individuals may appear in the same assessment group, for 
the over-all superiority of one may so prejudice the staff that they are apt 
Lo give him a higher job-fitness rating as well as a higher over-all rating. 
That this occurred at S is shown by the fact that officers were not only 
given higher over-all ratings than enlisted men, which is perhaps reasonable, 
but were also given higher job-fitness ratings, which was probably im- 
proper. The comments of laymen who were asked to make ratings of men 
in the theater clearly showed that they were even more affected by such 
factors as rank, prestige, and general ability. Thus the differential operation 
of this determinant lowered the agreement between assessments and 
appraisals. 

Finally, there was another factor worth mentioning which produced a 
difference between the frame of reference used in assessment and that used 
in appraisal. The staff at S was probably fairly successful in rating traits 
uninfluenced by knowledge of the candidate’s proposed assignment. It was 
relatively easy for assessors to make ratings free of this consideration, since 
all candidates went through similar procedures. The same detachment 
could not be achieved, of course, in appraisal. Consider two men, both 
passed by S after having been rated Low Average in Emotional Stability, 
One was to do administrative work and the other was to take part in field 
operations, The potential office worker, scheduled for a routine task at head- 
quarters in London, was passed without question with a final job-fitness 
rating of 3, because he would be in a relatively protected situation and be- 
cause be bad characteristics which made up for his mediocre emotional 
stabilhy. The operational candidate, faced with a strenuous combat job 
behind enemy lines in Malaya, was passed reluctantly with a fitness rating 
of 2, only because he had a number of critical compensating abilities. But, 
when these variables were appraised in the theater, the administrator in 
London, who had suffered no great strain, was rated High Average in 
Emotional Stability, whereas the agent in Malaya, who had shown some 
signs of breakdown under severe stress, was rated Inferior. Thus, in many 
cases, as a result of the operation of different standards, correlations were 
poor, even though the assessment ratings may well have been correct. 

At S, final ratings were made after sampling the behavior of a subject 
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in a wide variety of situations, all of which had some correspondence with 
events jn life. In the three days, a candidate e.xpericnccd more frustration 
stress, social prc.ssuie, tough intellectual work, and physical punishi cm 

Some of these experiences during asscssincni were relevant to his pronZd 
assignment and some of them were not, yet a subject’s hehavior over S 
entire range of experience was considered when ratings were made on K 
vnriabta. If a parson r=.c.„l i„a,U,,„„e,y ...."or ^re 

ions, his ,ob-fitness rating might or might not he aifeeted, depending upon 
the relevancy of the situation, but one or more of his trait Lings wou d 
certainly be affected. Conversely, a man might perform hriHiantlf in ^ts 
having no relation to his proposed assignment and thereby causc^iis trait 
n gs to be revised upward while his job-fitnoss .score remained un“ 
d. Ratings at assessment were made in compaixson with a broad frame 

lhr$Xra!“‘"’® "'I” I»cl li™ 

Judging a candidate again,si such a broad background, after he had acted 
m such a vanety of situation., yielded considerLle nmlerstancling oi Sfie 
total personally, but at the same time it resulted in lower correlations with 
appraisal findings. This difference may he explained by the fact that an 
praisal rater, generally speaking, were asked to cvaluaL people who had 

owe framVL^T"' based on a nar- 

mation. For instance, a group of boat crewmen rating other boat crewmen 
gave mtelhgence scores varying from 3 to 5. Similar Lings wele 

Ll^dLL these the Icvds of intflligeni 

n^uded m these two ranges were by no means comparable. ^ 

Finally, wartime exigencies prevented the staff from settinir un a nre 
plE™. Ttr rt for me in deckling on thoi, 

raiktmg from tlio requircmcnB of the praaical aii,iati„„ .ha, , 
weffltoraaa" Salir l” ”u 1“ V ‘'.e .man. .«» 

don of “ “.L ’:L t: : s'l :■ “■“‘“■■jr 

Since about ac bad too great power of decision. 

Jr “0= recommendad, a large 

of Tht abUi*™l t"’' 1° ',1 '’Ja 

?ua„l nf ir a ”P“' “f 'ki" lo^ e,f one 

qoa ta" tW whZ"^ '*■' “Ppoeedly poorest 

bee JlLtd h ‘ k ■ ^""'1 Profitable lessons would have 

been learned b, observing whieh cases sigm that our assumption, had 
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led us to accept as warnings of impending breakdown or as manifestations 
of weakness turned out to be invalid. It is likely that a number of com- 
monly accepted old wives talcs of psychology and psychiatry would have 
been blasted by following these rejected cases and observing individuals 
with the conventional stigmata of personality deficiency perform well under 
exacting conditions. Such critical experimentation was out of the question, 
because sending even a few potential mental cripples into the field for in- 
telligence operations could not have been justified when the paramount goal 
was winning the war. 

To check the accuracy of a prediction of performance level, it is essential 
to have clear and unambiguous criteria of success and failure. If the job 
is running a lathe in a large factory, the rate of piece-work production is 
a satisfactory criterion; if the work calls for social adjustment as well as 
efficiency, the criteria are more complex, but nevertheless not difficult to 
define. In OSS, however, assignments included such complex tasks as secret 
intelligence, sabotage, and propaganda writing. For these no definite ob- 
jective measures seemed meaningful, since the amount of damage an agent 
can do to the enemy is largely dependent upon his opportunities, just as the 
usefulness of the intelligence he reports is largely determined by the place 
to which he is assigned. Such quantitative measures of efficiency could there- 
fore be accepted to a limited extent only. Since there was little agreement 
among members of the organization about what constituted success in their 
respective fields, it was not easy for the assessment staff to define adequate 
measures. Lacking these, satisfactory appraisals of accomplishment could 
hardly be achieved, 

In the absence of any statement from the administrators of OSS as to how 
success in overseas missions would be measured, the assessors had to rely 
on their own judgment in selecting the best criteria against which to validate 
their methods. We chose what seemed to be the four best types of criteria 
that were obtainable, although none of these was free from serious short- 
comings. Their inadequacy is indicated by the fact that, in measuring job 
fitness, the four methods showed rather poor agreement, correlating among 
themselves only from .46 to .59. In respect to the different personality traits, 
agreement was even worse, the correlations falling between .28 and .50. 

Our predicament will, no doiiht, recall to the minds of those who worked 
in other selection units during the war their own difficulties in validating 
their procedures, 

THE FOUR APPRAISAL TECHNIQUES 

During the first year of the assessment program, four different approaches 
to the problem of appraisal were devised. None of these was really satis- 
factory, eacji suffering from a number of defects, including some of those 
mentioned in the preceding section. It was hoped that by making appraisals 
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from a number of different viewpoinis a true evaluation of assessment coull 
be made by a sort of triangiilation. At least, it was felt unwise to rely 
clusively on any single technique when it was possible to carry out a variety 
The four procedures undertaken were called Overseas Staff Appraisal 
Theater Commander Appraisal, Reassignment Area Appraisal, and P,’ 
turnee Appraisal. 


Overseas Staff Apprai,sal.-.Two menihcr.s' of the assessment staff obtained 
appraisals in the ETO, one in the summer of and one in the winter 
of 1945. Another former member of the staff sent ratings from the Mediter- 
ranean theater in the winter of i9;|5. In the summer of 1945 appraisals were 
obtained in China by two staff members, one of whom had previously re 
ported on the performances of assessed personnel in the ETO. Thus reports 
were received from four different p.sychological appraisers. These overseas 
appraisers did not all ii.se identical techniques, hut in general the method 
adopted was as follows: 

An appraisal in each case was obtained by interviewing the immediate 
chief or commanding nlTiccr tif (lie individual under coiusidcration, and if 
possible, several of his associates. After explaining the purposc.s of the inter- 
view and .stressing the need for accurate record.s, the investigator asked; 
^ What has Sergeant Hills been doing .since his arrival in the theater?’’ Then: 
Have these jobs been rtuitiiie tasks rcc|uirinR nothing but the efficient 
execution of orders, or have they called for initiative, resourcefulness, and 
imagination? Then: "Does he get along well with his associates?’’ “What 
effect ha.s he had on the morale of the organi'/xition?” And then: “How 
would you appraise Sergeant Hills’ ovcr-all usefulness to the organization 
-outstanding, average, or un.satisfactory ?’’ 

At this point the three categories for rating were defined more precisely: 

outstanding.-AU in all he has shown exceptional ability in the performance 
ot fiis duties; he has manifested initiative and resourcefulness; he has co- 
operated well with others and lifted the morale of his unit. 

average, -He has been useful to the organization; efUeient and cooperative 
tor the most part; a dependable worker, Inii he has not displayed, or had 
the opportunity to display, much ingenuity or imagination. 

been useful for one reason or another; he has 
\ ^ ^ shirkcci, or clisturbccl the organization with 

omplaints or outbursts of emotion, or caused friction, or lowered morale, 

J" appraisals (China theater), .the middle 

category was divided into two. High Average and Low Average. This 
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four-category scale proved most satisfactory in getting ratings from in- 
experienced informants, It was considered that Outstanding corresponded 
to ratings of 4 and 5 at the assessment center, that High Average corre- 
sponded to 3, Low Average to 2, and Unsatisfactory to ratings of i and 0. 

If the informant s rating did not seem to jibe with his estimate of the 
individuars performance, or if his rating did not agree with that given by 
other informants, he was questioned further and asked to give concrete 
instances to support his judgment. Some informants— branch chiefs, for 
example — were in a position to characterize 25 or more men, whereas others 
were able to discuss no more than one. Although for most individuals it 
was possible to obtain ratings from at least three or four informants, some 
could be rated by a single person only— for instance, a secretary who had 
done all her work under the supervision of one officer and was not well 
known by others. 

This overseas interviewing was conducted as informally as possible. The 
staff investigators went out of their way to develop good relations with 
their informants, being careful to explain to them that the information was 
desired for purposes of scientific investigation and the improvement of 
assessment techniques, and would have no influence on the future of the 
individuals being discussed. The interviewers desired no one to get the 
impression that they were acting as “stool pigeons.” 

Later, two different ratings on the six-point scale were given to each 
appraisee by the staff investigator: (a) an over-all rating of his total per- 
formance in the field, based upon the investigator’s observations together 
with his interpretation of the significance of the individual informants* 
views of the appraisee’s personality; (b) a numerical estimate of the reliabil- 
ity of this rating, taking into consideration how many people had given 
opinions; how much agreement there was among them; how much oppor- 
tunity the informants had to know the individual; and how dependable 
the staff investigator considered the informants to be. Occasionally the staff 
investigators became well acquainted with the individuals whom they were 
appraising and saw them working in their assignments. Information so 
gained was included among the other data upon which the final over-all 
ratings were based, and such firsthand observations usually had the effect 
of raising the estimate of reliability. 

Theater Commander Appraisal.— In the spring of 1944 the Personnel 
Board of OSS decided to require that, when any member of the organiza- 
tion returned from an overseas assignment, his immediate superior submit 
a report including ratings on personality traits as soon as the individual left 
the theater. The chief purpose of this report was to assist in the decision 
which had to be made in the case of everyone returning; whether he should 
be separated from the organization or retained for a further assignment. It 
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Motivation, energy, effort, 
initiative. interest in 
assignment 
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Effective iNTEuuGF.NCii, 
speed and accuracy of judg- 
ment, resourcefulness in 
solving problems, . . 
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Stadiutv. emotional control 
and maturity, absence of 
nervous symptoms. . 


1 

Am LIT V TO WORK WITH 
OTHERS, teamworicj tact, 
absence of annoying traits 


1 1 

Leadership, organizing 
ability, ability to win 
cooperation 



Physical Ability, agility, 
dating, rnggedness! 
stamina 



Rhmarks: 




AviiiviAKKS: 

COMPLETB REASONS FOE RETURN TO U.S. • 

ndations. g) {J° recommend his further use in OSS? 

^Dj IX SO, in what capacity? 

in addition to the effiZcZeDo^r*^^* submitted 

An effort was made to make tL OS°S ^ military records, 

make the OSS personnel report more meaningful 
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and complete than these other efficiency reports. To begin with, the OSS 
form was marked “CONFIDENTIAL” and “SUBJECT MUST NOT SEE 
1 HIS. The existence of the report was publicized, and the importance 
of filling it out carefully was impressed upon commanding officers. In an 
effort to overcome the leniency error so common in ratings of this type 
made by inexperienced laymen, extremely laudatory terms were used to 
head the various columns, Superior, Excellent, Very Satisfactory, Satis- 
factory, and Unsatisfactory were chosen rather than, for example, Supe- 
rior, High Average, Low Average, and Inferior. Also some clarification 
of the meaning of the psychological trait names was attempted by putdng 
short definitions after them. 

In order to analyze the results from this procedure quantitatively not only 
were the ratings of the theater commander recorded; his remarks were also 
read over by members of the assessment staff and given a rating of Low, 
Medium, or High on the basis of the degree of proficiency in the assign- 
ment reflected by them. The staff tried to make 25 per cent of these ratings 
Low, 25 per cent High, and the rest Medium. 


Reassignment Area Appraisal.— The transformation, in the fall of 1944, 
of Area F from a large training station into a reallocation center provided 
the psychological staffi with an opportunity to carry out another type of 
appraisal. As we have explained in Chapter VII, the primary function of the 
staff at F was the reassessment or re-evaluation of personnel who had com- 
pleted one tour of duty, chiefly in the European or In the Middle East 
theater of operations, and were being considered for assignments in the 
Far East. 

The F staff was also in a position to assemble data on grievances, to sum- 
marize off-the-record criticism of OSS operations, and to detect psycho- 
neurotic disturbances in returning personnel. While carrying out these 
activities it could also make detailed evaluations of the returnees’ person- 
alities and performances overseas, evaluations that could later be compared 
with the earlier assessment. 

The orientation booklet given to men arriving at Area F stated: 

The OSS is anxious to learn as much as possible about the war experience 
of its returnees, the special difficulties, discomforts, and dangers encountered 
by every man in every theater of operation. It is important for the administrators 
in Washington to know the mistakes that have been made, to understand why 
some operations have succeeded and others have failed. 

Therefore, every returnee will be scheduled for an Interview. . . . 

You can help us by speaking frankly of your satisfactions and dissatisfactions 
during your period of service overseas, your hardships, grievances, and disappoint- 
ments. 
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The program at F relied cliieily on tlie cliiiieal interview in coniunctinn 
with questionna res. When the interviewee reported for his appointment he 
was asked to fi 1 out an eicperience and liackground eiuestionnairc. In thi 
form were check lists dealing with hi,s psycliosoniatic responses to d"nae 
and stress, attitude toward superiors, causes for complaint, state of heakh 
and general outlook at the tunc of the interview. I'lic second half of the 
.questionnaire asked for information on developmental background includ 
mg region of rearing, parents’ ages or subject’s age at the thne of’parems’ 

mg World War I, attitude of family toward World War II, health in child 
hood, emotional stability in childhood, mental health of family, edueationai 
evel attained, preferred subjects in school, participaiion in a^Wetics po" 
tions of leadership held in school or college, and mechanical aptitude’ 

sruTvJ A tlie questionnaire, the interviewer could 

V ’l ^ subject’s superior officer, which was 

described above. Assessment reports on the interviewee, however, were not 

S thre. v’ '' mterview it.sclf, partially structured by a schedule, dealt 

historl^andt, (=) developmental 

History, and (3) political and social attitudes. ^ 

wa? i tlic interviewee 

Zs of h ' m 7'^ *’■* iKljustment to the condi- 

u;h' i 1 , ? assignment. Taking Into con-si deration the amount of stress to 
ich he had been subjected, the interviewer rated, cither Low, Medium 

ddec?'’ following traits were manifested: anxiety^ 

dejection, homesickness, irritability and quarrels, alcoholism, psychosomatk 
symptoms, and strength of complaints. " 

A discumon ot ,K« developmental background oi ihe man being la- 

r.e™r eoTuT ’“¥“""8 “ he had IrU- 

bl.. J “ mission, the staff was interested in studying his 

h stor, order >o att^pt ro discover how determinanrs of success ma, 

] ^ behavior and environmental conditions. Then the fob 

Sfitrir r""” ""h »“ »'emi famil 

P‘ p ctLveneSaS, and childhood attuudes toward di/hcLilticj The 

intemewer made Low-Medium-High ratings on most of these variaiill 

of special (icrmit adequate treatment 

01 special problems arising from the subject’.s recital of his experiences Of 

cZd arZnt f f his _progre,ss during the initial period, he 

member ^ I" meetings, or occasionally ask another stall 

vTwee r ZT" T" - the inter- 

viewee, rated him on the same personality variables that were used in as- 



The Evaluation of Assessment 403 

sessment, and gave an over-all score based on all information he had ob- 
tained. 

Returnee Appraisal, Although first devised in the summer of 1944, this 
technique was not implemented in the assessment program until a year 
later. It was then applied concentratedly over a period of four months by 
more than twenty members of the staff, and in this intensive program some 
degree of information on the performance and personality of a large num- 
ber of assessed personnel who went overseas was obtained. 

Great efforts were expended to make as full use of this method as possible 
because it was hoped that by getting reports from a number of superior, 
equal, and subordinate colleagues of each assessee it would be possible to 
get appraisals free from the particular biases of any given individual, of 
superior officers, or of members of the assessment staff. The method used 
was as follows: a member of OSS returning from an assignment over- 
seas would be met by one of the assessment staff, either at Area F or at his 
office in town. First, his assistance was requested in a scientific project of 
the assessment staff. Then, when he consented, he was given, with as little 
explanation as necessary to get his cooperation, a list of names of individuals 
who had been in his theater, and asked to check the name of each individual 
whom he knew. This list was composed of the names of all personnel in 
his theater of operations who had been assessed before going overseas, but 
the interviewee was not told this until he had finished checking the list 
The interviewer then told him the origin of the list and explained that a 
study was under way to discover, if possible, the effectiveness of assessment, 
His cooperation was elicited with the assurance that the information which 
he gave would be treated as confidential, and that whatever he said would 
have no influence either on his own future or on the future of the individ- 
uals under consideration, but would be used only for purposes of studying 
the validity of the selection program. Since this procedure was adopted 
largely after the end of the war, many of the people on the list had already 
left the organization; hence it was only occasionally that informants were 
unwilling to give candid reports for fear of the effects which might come 
to anyone on whom they made an adverse report. If the organization had 
not been disbanding and the informants had not been leaving it, this de- 
sire to forestall unpleasant results would undoubtedly have been more 
important than it was as a factor limiting the usefulness of this appraisal 
procedure. 

The interviewer then read from the list the first name checked, asking 
his respondent Informally what sort of person that individual was. When 
the interviewee had given as much of a description of the personality as he 
would without prompting, he was asked how well the man under considera- 
tion carried out his assignment overseas. When this had been answered, the 
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interviewer tried to draw out a more rounded character sketch. The com- 
ments of the informant were written by the interviewer on a form like 
the one shown in Table 24. 


TABLE 24 

Returnee Interview Form 


Interviewee Interviewer _ 

(Name and Rank) 


Job overseas, 


(Line left blank to record interviewee's 


intelliucncc and rclililiilily after 


interview) 




Subject 

(Nartic and Rank) 


(IIdw long and bow well itUerviewne knew him) 


Job overseas^. - ^ 

Motivatiofi for Assignment LMH Social Relations 
Effective Intelligence LMH Leadership 

Emotional Stability LMH Job 

COMMENTS; 


After these comments had been obtained, the interviewer explained that 
he would like to have the subject rated on a number of characteristics. The 
informant was asked to rate the subject on a three-point scale (I.ow, 
Medium, High), if possible, and to divide this further into a six-point 
differentiation when he thought this could be done meaningfully. Low Low 
he was to designate as oj High Low as i; and so on. It was explained that 
the distribution should fall on the normal curve with 0 and 5 each 7 per 
cent; i and 4 each 18 per cent; and 2 and 3 each 25 per cent. Commonly 
a diagram of such a curve was shown to the interviewee to help clarify the 
idea. Further, the interviewee was told that it had been our experience that 
there was usually a leniency error, so that he should be careful to distribute 
his ratings into all categories. This point was repeatedly raised throughout 
the interview, whenever many high ratings had been given, in order to force 
the rater to make a more normal distribution. 

Brief definitions of each of the variables were given to the interviewee. 
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and frequently he added further comments while making his ratings. These 
comments were also noted down. The interviewer frequently asked the 
rater to explain one of his decisions and if possible to give illustrative 
anecdotes. If the informant found he could not rate the individual under 
consideration on one or more of the variables, he was put under no pressure 
to do so, but that variable was skipped. For example, one informant might 
have known a specific individual only socially, and so would be unable to 
give him a job rating. 

In each case, in order to be sure that the person under consideration was 
properly identified, the informant was asked what position the subject had 
held overseas. Also he was asked how long and how well he had known 
the individual he was discussing. All this was noted on the forms by the 
interviewer, who, at the end of the session, rated the interviewee on his 
reliability in reporting on this given individual as well as on his apparent 
intelligence, so that the total reliability of the report could be adequately 
evaluated later. 

This procedure was repeated for each name checked by the informant. 
Occasionally it would appear that the informant really knew very little about 
one of the persons whose name he had checked, and if the interviewer were 
satisfied that this was the case, he passed over that name. Often, though, 
it was observed that informants used the device of saying they knew little 
about one person whom they disliked or concerning whom they felt they 
would have to give an unfavorable report. The interviewer kept constantly 
on his guard against tliis possibility, and whenever he suspected it was 
occurring he made an effort to draw out the informant as fully as possible, 
Sometimes, if one respondent had checked a large number of names, a 
fatigue factor entered in. Sometimes, also, there were necessary limitations 
of time, and under those circumstances the interviewer chose for discussion 
those individuals concerning whom the informant seemed to have the 
most information, even chough he was aware that in so doing he was de- 
stroying the randomness of the choice. 

All interview protocol slips so obtained were filed away together under 
the names of the assessed persons being appraised. In order not to make the 
appraisal dependent on the possibly one-sided testimony of any one in- 
formant, it was decided to establish a minimum criterion below which the 
individual could not be considered adequately appraised. This criterion was 
arbitrarily set at the level of three reasonably reliable informants. Moreover, 
the standard was not considered satisfactorily met unless at least three ratings 
(or comments which would lead to some idea of a rating) were given on 
each variable except Leadership. Ratings were much less frequently made on 
this trait than on the others, because many people had no leadership function 

overseas. .,..11 

When enough information was gained about an individual to satisty this 
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criterion, a conference of one senior and two junior staff members met to 
decide on final appraisal scores. All the ratings on variables given by in- 
fornaants-High, Medium, or Low, or 5, 4, 3, 2, i, or o-as well as the ratintis 
M the informant made by the interviewer, were placed on a blackboard. 
Then one member of the conference group read all the comments on each 
protocol slip. Thereupon each member of the conference (conferee) in the 
light of the comments and the ratings on the blackboard, wrote down his 
ratings on each variable on the six-point scale. When this had been com- 
pleted independently, the ratings were read, and if there was agreement 
t ey were recorded. When there was disagreement, the conferees tried 
to see If they could come to agreement by discussion; if they could not, the 
case was continued in order to get more data. 

Not only , each of the variables, but also the reliability of each whole ap- 
praisal picture was rated, the latter on a scale of Low, Medium, and High 
Some cases seemed unequivocal, with little disagreement among all die 
informants about the individual’s personality and performance. These were 
considered to have high reliability. Other cases were rated Low, either bc- 
cause of disagreement among the informants, or because of some incom- 
patibihty in their statements, or because of some deviation in their ratings 
Occasionally there was unanimity on all of the variables except one or two 
and marked divergence on these. In such cases the final ratings agreed 
upon in the con erence would be put in parentheses, and these ratings were 
never used m the statistics of appraisal studies. The conferees made an 

S? I" many cases 

wh ch technically met the criterion were discarded because it was thought 

that a satisfactory picture had not been obtained from the appraisal data. 

SHORTCOMINGS OF THE APPRAISAL TECHNIQUES 

All of the appraisal methods which we resorted to had faults which 
seriously diminished their value. This was unavoidable. Some of the faults 

methods, others are found in only one. Understanding them all, however 
is important as part of the total process of evaluating assessment. First let 

of thTT shortcomings common to more than one 

mlthodS^'^''" techniques and later turn to those specific to each of the 

turnee^AnnrnSf' limitation of the Overseas Staff Appraisal and the Re- 

the demoent T'' employed them we were reduced to 

dalthS n necessarily correct expedient of accepting as raw 

data the o^nton of any acquaintance or associate of the individual being 
ppraised. Of course it was possible for the staff to give special weight to 
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the statements of those who seemed best qualified to state the requirements 
for success in various assignments, but frequently it was difficult to deter- 
mine whose statements were most insightful, best considered, and based 
on the most complete background of experience. Hence the procedures 
often had the obvious disadvantage of giving equal weight to expert and 
inexpert opinion. 

It was obvious, and important in all except the Reassignment Area tech- 
nique, that informants varied over a wide gamut in ability to judge per- 
sonality and performance insightfully and objectively. Some were acute 
and accurate; others were dull and vague. Some praised nearly everyone; 
others were unduly critical; still others were moderate. As a consequence 
some reports were much more valuable than others. In the Returnee Ap- 
praisal method an effort was made to gauge this difference in usefulness 
by rating the informants on their intelligence as judges. Also in this pro- 
cedure and in the Overseas Appraisal, staff interviewers frequently asked 
for specific illustrative instances of the behavior of persons being appraised 
to substantiate the informants’ opinions, so that overrating or underrating 
would be revealed. Even with such precautions it was possible to allow 
only roughly for inequalities among respondents. 

2) The Theater Commander Appraisal technique, unlike those mentioned 
in the last paragraph, relied on the opinions of those who might be assumed 
to be experts, i.e., immediate superiors in the organizational hierarchy. 
Such a procedure, however, is likely to give a one-sided picture of a person, 
for such informants view an individual only from above downward, and as 
the Returnee Appraisal data showed, frequently disagree entirely with sub- 
ordinates. 

There was danger that in each of the appraisal techniques, but par- 
ticularly in the Theater Commander and the Reassignment Area procedures, 
information on which the judgments were based was rendered inaccurate 
by the desires and sentiments of the informants. Amour propre was a 
potent factor in producing such inaccuracies. In giving ratings, a superior 
is sometimes swayed by considerations such as a desire to receive credit 
himself for his subordinates’ actions or a wish to make his unit appear 
better than it really is. Sometimes an uncritical rating is a result of a com- 
mander's sincere but provincial belief In the high quality of his own unit. A 
large number of such high scores turned in by one commander so exas- 
perated his superior in the theater, who reviewed them, that he wrote, ‘*If 
everyone was so perfect in this unit, why didn’t they get more done in 
the field ? ” 

Prejudice of individual informants, of course, is a significant factor not 
only in the Theater Commander technique but also in each of the other 
methods, for each relies on the opinions of one or more respondents. Many 
of these informants were not motivated strongly to keep their likes and 
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dislikes from influencing their judgments. Many made such comments as; 
“Yes, George is a very efficient officer, but I don’t like him. He’s not my sort 
of guy ” The factors observed to operate most often to give rise to prejudiced 
judgments w^ere these: differences between respondent and the person he 
discussed in nationality, in civilian or military status, in military rank, in 
social status, in imaginativeness or practicality, in type of assignment 
(e.g., operational job or desk job), in attitudes toward order, regularity, 
and discipline, in temperament, nncl in drinking habitvS. When informants 
described persons of the opposite sex, it was often clear that the personal 
appeal of the individual under consideration often aflccted their judg- 
ments. 

3) In the Overseas and Reassignment Area methods, the attitudes and 
preconceptions of staff interviewers as well as those of informants were 
important. In any technique requiring judgments by assessment staff mem- 
bers, there is always danger that their ways of viewing persons, their 
theoretical assumptions, will influence their interpretations. Thus their final 
ratings can have spuriously high agreement with the original assessments 
because job performance and personality traits are seen by them from the 
assessment viewpoint. Every effort was made by staff interviewers to be 
objective, but there could be no guarantee that dicir interpretations were 
not colored by some such prejudice or that they did not diflcr from the 
conclusions which a military man, for instance, might derive from the same 
data. It must always be recognized that the opinion of the practical military 
expert on OSS assignments could well be more valid than that of an as- 
sessment staff member trained in the comparative seclusion of university 
halls or hospital wards. 

4) The Theater Commander and Returnee methods of appraisal re- 
quired the associates of the assessed personnel to make ratings on the per- 
sonality traits in terms of which they had been rated at S or W. Simple 
definitions of these traits as they were understood by the asse.ssment staff 
were given to the Informants, either by written instructions In the Theater 
Commander method or by an interviewer in the others. The score or more 
of interviewers undoubtedly used somewhat different definitions, but never- 
theless their divergence was not great cnougli 10 be the wliole cxtilanation 
for the disagreement among respondents. It was freciuently clear from their 
comments or illustrative anecdotes that these interviewees did not under- 
stand the terms at all as the assessment staff understood them. For instance, 
it appeared that leadership was equated with intelligence by some officers, 
and the fact that he was not a leader .sometimes was the sole reason given 
for rating a capable enlisted man as unintelligent. Again emotional stability 
and social relations were occasionally viewed as going together— if a man 
were a good drinking companion he was regarded as stable. When it was 
apparent that differences of conception between various raters existed, an 
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effort was made to allow for them, but obviously in many cases it was 
difficult to discover what ideas the raters had about the traits. Certainly 
“emotional stability” did not, for the lay informants, connote assumptions 
about psychiatric disease, psychosomatic symptoms, childhood traits, habit con- 
trol, character defects, and so on, which had been taken into account by 
the staff at assessment. But what the term did mean to them was often hard 
to tell. 

5) In all four of the appraisal techniques there were marked differences 
among raters or informants as to how they distributed their ratings over 
the various steps of the scales. In no case was the curve of distribution com- 
parable to the assessment distribution curves, and in many cases the curves 
were very greatly different. This fact in itself lowered the correlations be- 
tween assessment and appraisal findings. The great disparity in the use 
of the rating scale among five raters employing the Theater Commander 
technique is shown in Table 25. 


TABLE 25 

Percentages of Ratings in Each of Five Categories of the Total Theater Commander 
Appraisal Sample Compared with Similar Percentages for Five Individual Raters 
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80 
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It is clear from this table that very slight agreement existed between 
various raters on what distribution of ratings should obtain* The most com- 
mon tendency, that of giving predominantly high ratings, is demonstrated 
in the total distribution of ratings. However, an examination of the dis- 
tributions of individual raters gives the impression that the chief short- 
coming is an inability to discriminate over the whole five-point scale* 
Rater A, for example, seems to say, “There are two kinds of people in my 
outfit, whom I will rate ‘average* and ‘somewhat above average/** Raters 
B and D also distinguish essentially only two types, but call them superior 
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individuals and those who fall just short of being superior. Rater C clearly 
believes that the two types are the superior people and the failures. Medi- 
ocrity is ruled out. Rater E appears to have made an effort to discriminate 
over at least a three-point scale but contends that most of those he rated 
are considerably above average. 

No clear idea was conveyed in the instructions to the raters as to what 
percentage of personnel overseas should fall into each of the five categories 
on the scale. Other studies have shown that giving such a predetermined 
frame of reference is helpful, though only moderately so. It was not feasible 
to attempt to improve this distribution by the lengthy technique of man- 
to-inan rating in which the rater chooses men in his outfit to rcprc.sent each 
of the degrees of a given trait on the scale, then decides how each man he is 
rating compares to these standard representatives. 

Our data indicate that not only inexperienced lay raters shewed the rating 
scale from a normal distribution and committed the “leniency error” of 
giving more high scores than low; it seems that staff members made these 

TABLE 26 

Percentage of Ratings in Each Category of the Scale Ciiven hy Each of the Four 
Overseas Staff Appraisers 



1 

S .Scale 

Rater 

N 

0 j I i 5 

4 





S 

Classes 




A 

114 

0.5 

7-3 

19,2 

CO 

ii.9 

4.1 

B 

31 

9-7 

19.9 

15.8 

11,9 

2.9.0 

3 - 2 - 

C 

100 

7.0 

8.0 

15.0 

16.0 

35.0 

9.0 

D 

2.6 

7-7 

0.0 

7-7 

53.8 

30.8 

0.0 

Total.... 

371 

3-5 

8.1 

10.5 

35'6 

17.1 





W Classes* 




A 

2-9 

3'4 

3'4 

14. 1 

41.4 

10-7 

6.9 

D 

6 ^ 

1.6 

5.4 

11.3 

45.2 

31.1 

3 ,z 

Total., . . 

91 

2..1 

5'4 

15.0 

45.Z 

28.0 

4'3 


* Raters B and C appraised no one assessed at W. 
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errors alsoj though to a lesser degree, in both Overseas and Reassignment 
Area appraisals. Table 26, for example, gives distributions of the ratings of 
the four staff members who appraised overseas. 

It looks as if at least two appraisers had given too many high grades. 

If true, this fact could be explained by supposing that he had taken the 
reports of his informants too much on their face value and that his grades 
reflected the "leniency error’* usual in layman’s ratings. But it is more likely 
that the skewness of the distribution obtained by these appraisers gives us a 
truer picture of the personnel situation than a normal distribution of grades 
would have given us. 

Besides the fact that there is little reason to suppose that the efHciency 
represented by such grades was, in truth, normally distributed, there is the 
fact that there were numerous units in the OSS no member of which, as 
far as we could discover, was unsatisfactory in the fulfillment of his duties, 
and, in such cases, many informants could not bring themselves to give 
anyone in the group a rating of i or 0, even when the appraiser's instruc- 
tions were clearly and insistently presented to them. Thus the high grades 
indicate that most members of the OSS could not conform to the arbitrary 
distribution scale for rating their associates, because this scale did not cor- 
respond to the facts as they estimated them. This might be interpreted as 
evidence of high morale and, indirectly, of the success of the screening 
process. 

In this connection it should be remarked that we imposed on our returnee 
informants the conception of a normal distribution curve, instructing them 
to give about 18 per cent of their associates a grade of i and about 7 per 
cent a grade of 0. By so doing we ran the theoretical risk of setting up a 
rating scale which did not correspond to the assessment scale, and yet later 
making our statistical computations as if the two scales did correspond. 
Roughly speaking, if assessment had been completely successful, no man 
would have deserved a rating of i or 0 in the theater, since men of such 
caliber would have been eliminated in the screening process. As we knew 
would happen, however, even though we pressed them to use all categories 
in rating, our returnee informants did not follow the normal distribution 
closely and the total effect of this manner of proceeding was to compensate 
to a degree for the leniency error and to give a few men grades of 0 or i 
who probably were not unsatisfactory, but were merely the least effective 
members of a wholly satisfactory unit. 

6) Many evidences of the "halo effect” appeared in all the appraisal tech- 
niques, although they were less blatant in the Reassignment Area method, 
in which staff members determined the scores, than in the others in which 
laymen were the primary determiners of ratings. If a man' being appraised 
was liked or admired by a respondent, he was very co^mmonly rated high 
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on all traits without distinction. On the other hand, if he was thought to 
be low in one trait, or to have done a poor job, he was frequently rated 
low on all characteristics, although it is unlikely that he could have been 
so consistently undesirable. Discriminating distribution of trait ratings on 
a single individual was relatively rare. 

7 ) The accuracy of two appraisal methods especially, the Theater Com- 
mander and the Returnee techniques, was diminished by the hasty and 
careless manner in which some of the ratings were made. Many of the 
Theater Commander reports were filled out in a haphazard and hurried 
manner. This could be Inferred, for example, from the similarity of ratings 
given to whole units of men who had obviously performed in the field 
different »sort5 of jobs with what must have been different degrees of 
efficiency. Haste could also be inferred from the absence of remarks on the 
man’s report when it was clear that the commanding officer must have 
possessed much pertinent information. In a number of instances these re- 
ports were filled out, not by the individual’s immediate superior, but by 
some substitute who was scarcely acquainted with the man, 

The rating scale was short and there could have been no fatigue effect in 
rating a few men, but personnel frequently returned home in iWge groups, 
and the busy commander would rate them all in one sitting. This necessity 
sometimes contributed to the slipshod way in whicli this important job 
was done. 

The interest in the Returnee appraisal indicated by the informants in de- 
voting their energies to this project varied from very little to very great. 
Those who did it as an obvious chore were released from the necc.s.sity of 
completing it, but even those who did it willingly often glo.sscd over some 
cases and made snap judgments in an effort to fini.sh rapidly. In the re- 
spondents who gave information for more than eight hour.s, fatigue was 
unavoidable. “ 

8 ) In the Theater Cornmander, Oversea.s, and Returnee procedures there 
were wide divergences in closene.ss of acquaintance, ship between the in- 
formant and the man being apprai,scd. They may have known each other 
a short or a long time; in the organization only or before entering it as 
well; only socially or only in busine.ss; casually or as roommates or best 


1 If ^'^^ respondent knew the individual as a co-worker, he may easily have 
liad a different opinion of his social relation.s, for example, than soineone 
who knew him only after hours. He may have been a congenial drinking 
companion and a crabby boss. Each view might have been correct in its 

own limited area, hut it was hard to combine them into one valid over-all 
rating. 

9 ) The three appraisal methods mentioned in the last paragraph have 
another fault in common: the relationship in the field between the informant 
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and the appraisee frequently determined the nature of the report about 
him. Subordinates and superiors often had entirely different impressions, 
and in more than one case this was so obvious that it was impossible to ar- 
rive at any final conclusion, because the enlisted men had one view of a 
man while the officers had a distinct and irreconcilably different one. Simi- 
larly, when the appraisee and one of the informants were members of the 
same clique overseas, but another informant was not a member, it was 
common for markedly different opinions to be expressed. Of course both 
such views may have a measure of truth in them, but it is not possible to 
represent the two truths in a single quantitative rating. 

10) Interviewees and informants occasionally withheld information be- 
cause they questioned the purposes of the research, even though assurance 
was given that the data would be used only for the evaluation of assessment. 
They thought that anything unfavorable they said about their acquaintances 
might redound to their own or their associates’ disadvantage, and they re- 
fused to “stick their necks out.” This was particularly marked in the Re- 
turnee Appraisal interviews of members of small groups that had had a 
strong esprit de corps abroad and had come back to the United States 
together. 

11) The manner of conducting the Overseas Staff and Returnee appraisals 
was faulty in that it did not control the factors determining which men 
were discussed by respondents, Striking characters, good and bad, were 
reported upon more frequently than less colorful figures, and opinions about 
such vivid personalities arc especially susceptible to the errors of hearsay. 

12) To get the information they wished, staff interviewers put questions 
to the appraisers in the Overseas Staff and Returnee techniques, These 
psychologists and psychiatrists attempted to ask neutral and nondirective 
questions, but there can be little doubt that errors repeatedly crept into 
the data, that ratings were influenced because leading questions were 
asked of the respondents, that rating categories were given inaccurate defini- 
tions, or that certain factors were given undue stress by the staff member. 

13) When there was strong disagreement among the informants concern- 
ing a specific individual being appraised by either the Overseas Staff or the 
Returnee method, the staff attempted to discuss the person with enough 
of his other acquaintances to be able eventually to learn what the prepon- 
derant view of him was. Nevertheless it was sometimes impossible to talk 
to a sufficient number of respondents to be able to develop a synthetic por- 
trait of the man which would explain all reactions to him. In such cases the 
final ratings had low reliability. 

These thirteen sources of error were common to more than one of our 
appraisal procedures. There were probably others we have not recognized 
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and described. In addition to these were some faults found only in one 
specific method: 

Overseas Staff Appraisal.^i) In the Returnee Appraisal, the interviewers 
followed with a good deal of uniformity prearranged standard procedures 
of gaining information; in the Overseas Staff method each appraiser de- 
veloped his own procedures, since they had not been coordinated before 
these staff members left the United States. Some of the appraisers, for 
example, incorporated their own direct observations of performance in the 
field with facts gleaned from interviewers; one, however, relied wholly on 
interview data, It is clear that this diversity of approach by the staff mem- 
bers led to dissimilar findings and thus diminished the usefulness of the 
Overseas Staff Appraisal. 

2) It might be thought that the staff appraisers, having been present 
before they went abroad at the assessment of a number of the appraisees, 
would have their judgments concerning these persons prejudiced by a 
natural inclination to seek for confirmation in the theater of the assessment 
predictions. There was perhaps some element of this, but it was certainly 
not very great. First, a large proportion of the men appraised were strangers 
to the appraiser because the latter had not been working at the station at 
the time assessment occurred. Second, at assessment only the ‘‘student” 
names of the candidates were known, whereas in the theater their real 
names were used exclusively, Rarely, then, did an appraiser realize that the 
Captain Jenks who was being rated was Student Bill of Class S-13, Third, 
all assessment ratings remained in Washington, and it was impossible for 
the appraiser to remember more than a very few of them by the time he 
arrived overseas. Finally, though the appraisers tried to be impartial at all 
times, they were not so much aware that they were seeking confirmation 
of assessment judgments as they were, occasionally, aware of the reverse. 
They were attempting to reveal errors, because chiefly through the dis- 
covery of errors could the assessment techniques be improved, 

3) The principal fault of the Overseas Staff Appraisal is that it was not 
prosecuted extensively enough. There were not enough appraisers in the 
field; they did not remain long enough; and they did not get information 
on enough cases. Besides giving a single over-all rating on performance 
overseas, the appraisers should have attempted to rate all the personality 
variables and the job accomplished as well, just as was done at assessment. 
And perhaps also, the staff members should have tried to base more of their 
judgments on actual observations of performance on the job, rather than 
on the reports of others. Of course it would have been impossible to 
shadow secret agents and saboteurs to see how they discharged their duties, 
but direct observation of people carrying out many sorts of assignments 
would have been possible. 
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Theater Commander AppraisaL~i) Many of the raters were military 
men accustomed to the accepted procedure in the War and Navy Depart- 
ments of giving high ratings to anyone who had not failed miserably. 
Despite the fact that they were told that such methods should not be 
employed in OSS, these raters seemed to find themselves unable to abandon 
the usual practice, and nonmilitary raters, realizing this, refused to penalize 
their own subordinates by using a different procedure. 

2) A fault of minor importance in this technique is that the theater 
commanders were asked to rate the variables on a five-point scale. Hence 
the scores arc not directly comparable to the assessment ratings on a six- 
point scale. Correlational studies between the two sets of ratings are still 
possible, however. 

Reassignment Area Appraisal. — i) The need for relying on secondary 
sources also constituted a shortcoming of the appraisal carried out at Area 
F, The Reassignment Area interviewer may have had a better opportunity 
to judge the personality of the man being appraised than the staff member 
in the field, but also there was greater possibility that his impression of the 
man would color his evaluation of his achievement overseas. While placing 
chief reliance on the factual information and ratings supplied by the 
theater commander, the interviewers at the Reassignment Area were forced 
to depend to some extent on their skill and experience with OSS personnel. 
It is to be supposed that ineffective men made efforts to disguise their 
shortcomings; that some mediocre individuals glibly exaggerated their con- 
tributions; and even conversely, that highly successful individuals were 
guilty of understatement. Such distortions of truth commonly diminish 
the value of brief interviews, and can only partially be compensated for by 
intuitive interviewers. The task at Area F was made easier by treating the 
returning member of OSS not as a man on trial, but, rather, as one to 
whom the interviewer and the organization were indebted because he was 
qualified to offer constructive criticism and help in other ways to improve 
the operations and personnel selection of the organization. 

Although this approach did much to put the Interviewee at ease and pre- 
vent him from erecting defenses and barriers, reaction to the Interview 
was by no means uniform. Attitudes ranged from outright truculence and 
resentment through polite indifference to eager cooperation and friendliness. 
Where one person found in the discussion an opportunity for catharsis, an- 
other responded to the situation with reserve and demanded that the most 
innocuous information be treated with utmost confidence. Generally the 
atmosphere was friendly and informal, but it was clear that the accuracy 
of the appraisal must have varied widely from one case to another.^ 

2) The over-all rating giving at Area F in some respects differed 
markedly from assessment or Overseas Staff Appraisal over-all ratings, be- 
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cause the reallocation program was oriented toward selecting the best men 
for duty in die Far East. Emphasis was placed upon predicting the success 
of a man in a new undertaking under radically clilTcrcnt environmental 
conditions, rather than upon the accurate cletcrniination of his achievement 
in his previous assignment, To be sure, [)ast accomplishment was an im- 
portant datum. It was assumed, naturally, that the general characteristics 
of the personality would be as important in C^bina as in Africa or France. 
At the same time it was understood chat many members of OSS had been 
successful in the European and Middle Eastern theaters precisely because of 
their familiarity with the language and customs, or because their emotional 
attachment to one of the countries in these regions motivated them highly. 
Many men who performed well in Europe had little desire for an assign- 
ment in China. Others who desired to go to China and the Far East 
possessed personality characteristics which suggested that their adjustment 
to Orientals and Oriental customs would be poor. Still others who had 
made conspicuous successes in previous jobs showed signs of “combat 
fatigue*' which required indefinite assignment in the United' States. In a few 
cases the reverse situation existed, that is, .some not suited for European or 
Middle Eastern jobs appeared to have a combination of traits which would 
make them successful in the Far East. 

As a rating to use in appraising assessment, therefore, the Reassignment 
Area ovcr-all mark was far from satisfactory, for it was primarily prognostic 
and only secondarily a judgment of past accomplishment. 

Returnee Appraisal.— i) Sometimes several months had elapsed between 
the time an informant last saw a man and the time he rated him; hence 
we^ might surmise that in some cases the informant’s memories were less 
vivid and reliable than they would otherwise have been. It Is possible, 
however, that the judgments of over-all merit were more judicious because 
of this slight degree of “historical” perspective. 

2) The outstanding flaw in the Returnee Appraisal method has already 
been mentioned, It was that of imposing the normal distribution curve 
as a frame of reference. If the informants had scrupulously followed the 
directions given them, 25 per cent of the assessed personnel would have 

een marked Low (0 or i), equivalent to Unsatisfactory, even if none of 
them had been unsatisfactory. 

3) There were opportunities for error at the Returnee Appraisal staff 
rating conference. Frequently the interviewers were not present .at the 
conference and the estimates of the clependahility of each informant had 
to be made without the help of the additional information they possessed. 
Also, It was often difficult to arrive .at a composite figure for the different 
notations of ratings which were placed on the blackboard-both Low, 

e lum, High, and 0-5— with some allowance for the leniency error, a large 
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proportion of all ratings being High. Not knowing who the informants 
were and not having adequate evidence of their dependability, we had 
nevertheless to make inferences, realizing that a 2 from one informant 
might equal a High from another, 

4) After the staff conferees made their individual ratings, there were 
disagreements in some cases. These were not great, as the high coefficients 
of reliability in Table 27 indicate. 


TABLE 27 

Reliability of Returnee Appraisal Ratings by Informants and Staff Conferees 

(Reliability coeffidetits — t}) 



Degree of staff confidence 


in ratings from protocols 

Type of agreement measured 





1 Low 

Medium 

High 

Agrecmeiu among informants 

.30 

.38 

.41 

Agreement among staff conferees 

.68 

.78 

.91 


Table 27 presents the reliabilities (agreements) of the job ratings made 
by (a) the Returnee Appraisal informants and (b) the staff conferees. 
It will be seen that the staff conferees agreed well in their ratings, particularly 
on the group of cases in which they had expressed high confidence in the 
ratings obtained from the informants. The informants’ ratings, however, 
show only fair agreement and the differences are not great between the 
coefficients for the groups with the three degrees of confidence. 

STATISTICAL ANALYSIS OF APPRAISAL POPULATIONS AND RATINGS 

Of the total of 2,748 assessed personnel who went overseas, we obtained 
some sort of follow-up material on approximately two thirds. Altogether 
1,708 persons (or 62 per cent of the total who went abroad) were appraised 
by the Returnee technique, but the information obtained on 1,197 these 
cases did not meet the minimum criteria of acceptability; hence only 511 
persons (or 19 per cent of those who went overseas), can be considered to 
have had satisfactory appraisal by this method. We obtained 468 Theater 
Commander appraisals (17 per cent of the assessed persons who went 
abroad); 466 Overseas Staff appraisals (17 per cent); and 41 1 Reassign- 
ment Area appraisals (15 per cent). Of course there were overlaps among 
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these techniques, some individuals being appraised by 2, '•(, or even 4 
methods. All told, 1,189 persons (43 per cent) received 1,853 acceptable 
appnaisals. 

The complete detailed analysis of these appraisal data is not of siifTicicnt 
interest to justify publication. We shall limit ourselves to a few findings. 

Leniency Error — This error was much more obvious in the Theater 
Commander appraisals than it was in others. In rating tlic dincrcnt 
variables of personality, theater commanders showed even more leniency 
than they did in rating job fitness. Their highest ratings were for Motiva- 
tion, their lowest for Leadership. 

Effect of Military Rank on Ratings.—In contrast to most studies of 
military and semimilitary organizations, appraisals of OSS personnel showed 
no positive correlation between military rank and ratings. Only on Effective 
Intelligence and on Leadership were the officers rated distinctly higher than 
the enlisted men. On Motivation civilians were rated highest. 

Length of Overseas Service.— Two of the methods-the Theater Com- 
mander and the Reassignment Area tcchnicities--showcd that the men who 
had been overseas longest were likely to receive the highest ratings. The 
correlation between the general remarks in the Theater Commander tech- 
nique and length of time overseas was .23 (^=235); bcl.vecn the over-all 
rating in the Reassignment Area method and length of time overseas 
.19 (IV=4ii). Both of these coefficients are significant beyond the i per 
cent level. Perhaps these positive correlations indicate that the first people re- 
cruited by OSS were better than those sent overseas later, and indeed it was 
the impression of the stall that the quality of the assessed personnel 
gradually fell off as the months of the war progressed and the man-power 
shortage increased. Another explanation might be that leaders abroad keep 
with them longest the people they consider best. It is also possible, however, 
that^ a fault of the Theater Commander technique is that length of time 
serving under the superior officer (that is, degree of acquaintance with 
him) and length of general operational experience arc important deter- 
minants of the grades. (Since the ratings from this method affected the 
ratings given at the Reassignment Area, it is imdeistandalilc that the latter 
technique would show the same effect.) Whatever the explanation for 
these slight positive correlations, the opcratitin of this factor is likely to 
make for less agreement between these two appraisal methods and assess- 
rnent, because the latter, of course, took no account of how long the indi- 
vidual would be overseas before appraisal. 

Adequacy of the Samples.— Our analyses show that the appraised popu- 
lations do not represent all periods of assessment equally, for there arc 



The Evaluation of Assessment 419 

many more from the earlier S and W classes in each of the samples than 
from the later classes. This is unfortunate, for it means that the bulk of 
our data refers to assessces who were subjected to what was probably the 
least satisfactory assessment. 

The figures show that our samples were well distributed in respect to 
the categories of sex, age, military status, and proposed assignment, 

Factors Diminishing Size of Populations Available for Study Al- 

though respectably large samples of all assessed persons who went abroad 
were appraised by the different methods, the populations on which it was 
possible to make appraisal computations were not so large as these. For 
one thing, it did not seem legitimate in many cases to consider the W 
and S personnel together, because the two assessments were so different. 
This one decision served to cut approximately in half the population avail- 
able for study in any one problem. 

Furthermore, for the S population there was no job rating, strictly 
speaking, until class S-45. Since more than half of the S cases that were 
appraised fell into classes 1-44, less than 50 per cent of the whole appraised 
group is available for comparing assessment job decisions with appraisals 
of overseas performance. 

The situation was not precisely the same for the over-all ratings at S, 
but it is true that a less satisfactory type of over-all rating was given before 
S-45 than afterward. The earlier rating was made by a single staff member, 
who read through all of the reports for classes S 1-44 some months after 
those reports had been written. In the light of these evaluations and the 
ratings which were made on the variables, often very meager information, 
he gave over-all ratings of Low, Medium, or High, attempting to put 25 
per cent into each of the two extreme categories and 50 per cent into the 
middle. This was, of course, much less satisfactory than a grade given by 
agreement of the total staff based on individual ratings which were later 
pooled, a score which was derived immediately at the end of the discussion 
of the case at the staff conference rather than months later. Moreover, 
the definition of the over-all rating used for the first 44 classes was not 
identical with the definition used later. In Table 28 it may be seen that, 
although the appraisal populations are relatively large (there being an aver- 
age of about lyi types of appraisal for each of 531 W cases and nearly 2 
types of appraisal for each of 656 S cases), nonetheless in considering job 
ratings from S, one of the most important groups of data, there was no 
sample of more than 100 cases available for study which had been evaluated 
by any single appraisal technique. 

When for purposes of analysis one wishes to hold constant such a vari- 
able as the reliability rating of Returnee Appraisal judgments, or when one 
wishes to investigate a given appraisal method in terms of each of the indi- 
vidual ratings given on the six-point scale, these populations of less than a 
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TABLE 28 
Appraisal Populatiniis 


Type of Appraisal 

All S 

Theater Commander. 

3-37 

370 

2.08 

2.90 

Overseas Staff 

Reassi^^nment Area. . 

Returnee 


Total number of appraisals. 
Total number of cases appraised 

1,105 

65S 


S"i|5 on 
Cjoh r*uinii5 
available) 

88 

53 

53 

317 

lOL 


All w 


3,31 

91 

103 

2.11 

747 

531 


It would bo extremely valuable for tbeorctical purposes to compare in 

sing cases on whom two or more types of appraisal are available Table 
shows the number of overlaps that occurrell among the cl i u t d 
niques It will be seen that never did any two given types of annrd I 
coincide on more than 258 cases, even when S and W cases were combined 

TAT3LE 29 



Theater 

1 Ovt 

rseas 1 


Commander 

SraiT 

Type of appraisal 

S 

w 

S 

W 

Theater Commander 




III 

i 6 

Overseas Staff. 

III 

T 6 

Reassignment Area. 
Returnee 

137 

84 

III 

60 

87 

114 

9 


Reassignment 

Area 


137 

H7 

76 


W 

I3.I 

9 

44 


Recur nee 


84 

114 

76 


w 

60 

14 

4 ‘t 


Intercorrelatioiu among Appraisal Techniques ~Th^ i t • 

correlation among the four aoDraisfll 1 ^ c' ■ of inter- 

cussed at length earlier ^ J have dis- 

length earlier m this chapter the di/Hculties involved in developing 
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reliable criteria of good and bad performance in the field. The greater the 
divergences among the criteria embodied in the different appraisal methods, 
the lower would be the intercorrelations among them. In Table 30 these 
intercorrelations are shown. 


TABLE 30 

Intercorrelations among Appraisal Ratings for All Assessed Cases on Which 
Each Pair of Criteria Was Available 


Type of appraisal 

Theater Com- 
manders’ 
general 

1 comments 

Overseas 

Staff 

1 

Reassignment 

A.rea 

Returnee 


f 

1 ^ 

r 

N 

r 

N 

r 

N 

Theater Commanders’ 
general comments. . . 



■59 

113 

.58 

137 

•49 

1 17 

Overseas Staff 

•59 

113 

— 

— 

,46 

96 

.50 

136 

Reassignment Area. , . , 

.58 

2-37 

.46 

96 

— 

— 

■49 

109 

Returnee 

•49 

1 17 

.50 

136 

•49 

109 




The fact that these coefficients vary between .46 and .59 would indicate 
that, while there is a small core of agreement among the informants or 
raters in the various techniques about the qualifications for adequate per- 
formance of these jobs, there is also a large number of factors peculiar 
to each specific technique which lowers the intercorrelations. It is interest- 
ing that the range of these correlations is so small, because it shows that 
no one appraisal method is markedly better than another in respect to com- 
mon elements. There is, of course, no certainty that the core of agreement 
among these techniques is in any absolute sense correct— our figures show 
only that no appraisal procedure revealed this core much better than any 
other. 

The ratings by the different techniques were obtained entirely inde- 
pendently, of course — with one exception: the interviewer who gave the 
Reassignment Area Appraisal rating in the majority of cases had before 
him at that time the Theater Commander Report, and he intentionally 
amalgamated these data with his own findings in arriving at a final grade. 
It is therefore to be expected theoretically that the agreement between these 
two types of appraisal would be high. It is, relatively, though there is one 
other intercorrelation in Table 30 that is slightly higher. 

Relationships of Reliability Ratings to Agreement between Assess- 
ment and Appraisal — In an ideal appraisal study, the coefficient of 
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correlation between assessment and appraisal would be unity, if both 
methods were perfect. The correlation would be diminished 'to lesser 
values by imperfections in either assessment or a{)praisal. If, for instance 
the correlation between an appraisal technique and assessment were 5 the 
assessment might theoretically he entirely valid and the appraisal me’thod 
so inadequate that the final correlation between the two would be at this 
level; or contrariwise, the appraisal might he wholly valid and the assess- 
ment so poor that the correlation is lowered to .5. It is impossible to tell 
from a simple correlation which of these situations exists, or whether both 
assessment and appraisal are imperfect. However, it is reasonable to assume 
t at there are errors in both. If this he true, then doing anything to increase 
the reliability of appraisal ratings should result in higher correlations between 
those scores and the assessment data* 

In an effort to increase reliability, so-called "reliability” ratings were made 
of the decisions derived from two types of appraisal, the Overseas vStaH 
and the Returnee. The term ‘Veliability” applied in this way is misleading 
because these scores do not measure statistical reliability, but rather repre- 
sent^clinical estimates of how confident we were that the rating given was 
the “correct” one. If a judgment was obtained by a staff interviewer from 
a person who was obviously insightful and able to make shrewd analyses 
or hutnan personality, his rating was considered more '‘reliable” or “cor- 
rect” than the average. Similarly, if there were good agreement amnnu a 
number of informants about a certain individual, their pooled opinion was 
also considered more ‘‘correct.*^ 


In the light of such considerations it was decided to determine whether 
the correlations between assessment job ratings and appraisal job ratinirs 
increased as the “reliability” of the latter increased. But, somewhat to our 
surprise, correlations both for the Overseas Staff Appraisal and for the 
Returnee Appraisal demonstrated no such effect. There are several possible 
explanations. Many of the judgments of "reliability" may have been wronff. 

n interviewer was likely to give a relatively high mark to a very articulate, 
clever, analytical informant, regardless of the possibility that his thinkinR 
was oriented by a strong personal sentiment or prejudice; and he was likely 
0 give a low mark to a man who was unable to give plausible reasons for 
Ins rating even though this rating actually represented an emotionally bal- 
anced judgment. Furthermore, our practice was to give each informant 
one over-all grade on dependability, although probably In many cases, he 
was judicious in some of his ratings but biased in others. Perh.aps actually 
here was not much difference between the appraisal job ratings in respect 
heir reliability, and so the scores given by the interviewers and con- 
ferees were largely artifacts. Also, the populations involved may have been 

too small to reveal a statistical difference between "reliable” and “unreliable” 
ratings. 
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APPRAISAL FINDINGS 

None of our statistical computations demonstrates that our system 
of assessment was of great value, This negative result suggests that two or 
three, or all, of the following statements are true: (i) The appraisal pro- 
cedures were to some extent defective. (2) The assessment procedures were 
to some extent defective. (3) The staff members were to some extent 
incompetent, partly because they were inexperienced in making predictions 
of this kind and partly because their knowledge of the jobs and of the 
environments overseas was inadequate. (4) An individual’s relative effective- 
ness under such shifting conditions as prevailed for OSS men and women 
overseas depends more upon chance— the occurrence of improbable and un- 
predictable situations and events— than it does upon relative ability, degree 
of motivation, and strength of character. Our data are not of much help 
in deciding to what degree, if any, each of these statements is correct. 

The Order of Magnitude of Correlations between Assessment Rat- 
ings and Appraisal Ratings. — In Table 31 are shown the correlations be- 
tween assessment job ratings and appraisal job ratings. Examination of the 
figures reveals (i) that all the correlations are positive but of a low order 
of magnitude; (2) that the method of Overseas Staff Appraisal yielded the 
highest correlations; and (3) that the W job ratings had higher validity 
than the S job ratings as measured by the Overseas Staff Appraisal and the 
Reassignment Area Appraisal. 

TABLE 31 

Correlations between S and W Assessment Job Ratings and Appraisal Ratings 


Type of appraisal 

S job racing 
(Classes 8-45 on) 

W job rating 

CAll classes) 

r 

M 

r 

N 

Overseas Staff Appraisal 

•37“ 

88 

• 53 * 

83 

Returnee Appraisal ' 

■19“ 

93 


173 

Theater Commander's comments 

•^3 

64 

■15 

158 

Reassignment Area Appraisal 

.08 

53 

.30“ 

178 


‘ Cases in which correcting r for restricted sample made a significant difTcrence; r given in 
each case is tJic corrected one, 


From the start, before the correlations were computed, it was generally 
agreed that the Overseas Staff Appraisal was our most valid method; and 
now, having found that the ratings obtained by this technique are more 
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highly correlated with assessment ratings than are those obtained by other 
metliods, we are all too humanly dis|K)scd to be still more convinced that 
this one was the best. Its defects are inherent in every validation procedure 
which unavoidably and realistically relies on the judgments of the appraisee’s 
associates. The Overseas Staff Appraisal and the Returnee Appraisal are 
very similar in design. Jlssentially, Ixnh are sociometric techniques in which 
an interviewer, unacquainted with the appraisee, plays an impartial role 
by defining terms, requesting evidence, and making sure that each rating 
is given after some reflection by a man who bus suflicient ground for an 
opinion. 

The staff members who collected the overseas appraisals did not foresee 
at the time they were interviewing their informants how crucial their re- 
ports would be in deciding the value of assessment procedures. If they had 
all fully realized the importance of their function, their reports, without 
doubt, would have been more complete, more detailed, and more accurate. 
As a result, correlations with assessment ratings might have ranged between 
.45 and .60, rather than between .37 and .53, as shown in Table 31. These 
last figures, as it happens, are probably a little too high, because of an 
error inherent in the Overseas Staff technique (and to a lesser degree in the 
Returnee technique), A few men who were rated Medium or Superior at 
the time the staff member visited the theater later proved unsatisfactory. 
Thus the effectiveness of some men declined with time. Running contrary 
to this decline, however, was the trend noted earlier, namely, that ratings 
were higher, on the average, for men who had served a long time in the 
theater than they were for those who had served a short time. 

The correlations between assessment ratings and the ratings derived 
from the theater commander’s comments are very low, but not lower than 
would be expected by anyone who is acquainted with the way these reports 
were filled out en masse by harassed administrators. The defects in this 
technique have already been reviewed. 

All the pertinent information which the interviewer at the Re.assignmcnt 
Area had at his disposal was contained in the overseas report. Consequently, 
most of the defects listed in connection with the Theater Commander tech- 
nique apply equally well to the Area F technique. The Reassignment job 
rating differed quite frequently from the rating given on the man’.s theater 
record, but, in such cases, either the interviewer had little more than hhs 
clinical impression to guide him or he was grading the man according to 
h’ls suitability for an assignment in China, that i.s, not strictly according to 
his past effectiveness in the European or Mediterranean Theaters, Thus 
there is no good reason to expect the Reassignment procedure to be any 
better than the Theater Commander procedure. 

The number of unsatisfactory cases listed in the reports obtained by the last 
two methods is spuriously high, because of the fact that all “failures” in 
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the theater were sent home, while the “successes” were retained. Conse- 
quently, there were periods during which almost all the returnees who re- 
ported at Area F were men who had proved unsatisfactory. Although most 
of these men had gone overseas before assessment was established, some of 
them had been recommended at S or at W. 

These, then, are some of our rationalizations for the low correlations 
obtained by three of our appraisal techniques. We are disposed to believe 
that if the Overseas Staff appraisals and the Returnee appraisals had been 
properly conducted, and the reports and ratings derived from these two 
methods had been combined, the median of the coefficients of correla- 
tion between the assessment and the appraisal job ratings might have been 
about .5 (it was .45), perhaps lower than this for S and higher for W. 
This is assuming that the process of appraisal had been executed, not per- 
fectly to be sure, but as well as was humanly possible under the conditions 
that existed, and, therefore, that one would have to look elsewhere — at 
assessment procedures and at occurrences in the theaters of war — to explain 
why the correlation was net higher. 

Percentage of Unsatisfactory Cases.— Another measure of the efficiency 
of the screening process is the pcrccnlage of men passed by assessment who 
were rated Low (0 or i), or Unsatisfactory, on their performances overseas. 
Tabic 32 gives the relevant figures. The errors exhibited here are much 

TABLE 32 

Unsatisfactory Cases in Populations of Previous Table 
{Those appraised Low who were assessed Medium or HishY 



S job rating 

1 (Classes S-45 on) 


W job rating 
(All classes) 

Type of appraisal 

Hb 

Mb 

% Unsatis- 
factory 

Hb 

Mb 

% Unsatis- 
factory 

Overseas Staff Appraisal. . 
Theater Commander’s com- 

3 

10 

1 14.8 

I 

4 

6.0 







ments 

2. 

9 

13.4 

7 

17 

15.1 

Reassignment Area Ap- 







praisal 

1 

4 

II. 3 

I 

7 

4-5 

Returnee Appraisal 

4 

II 

16,1 

3 

3 

3-5 


“'Low for Assessment means o or i. Theater commander’s comments and overseas staff 
ratings were made in terms of Low, Medium, and High; for other two appraisals Low means 
0 or i; Medium means 2 or 3; High means 4 or 5. 

H means number assessed High, appraised Low; M means assessed Medium, appraised Low. 
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more serious than those we have been considering up to now. If a man 
who is rated Medium (2 or 3) at assessment turns out to be High (4 or ■jl 
overseas, or if another is assessed High and is later appraised Medium, 
these are technical mistakes which worry the assessment staff, but they do 
not furrow the brow of any administrator. His wrinkles are deepened by 
the men assessed Higli or Medium, who fail to measure up to minimal 
theater standards and so impede the smooth functioning of his unit. These 
are his headaches. 

It appears from the table that about ii to 16 per cent of the cases recom- 
mended by Station S were judged to be Unsatisfactory in the theater, and 
about 3 to 15 per cent of the cases passed by W were so graded. 

An examination of the findings on the W cases shows that the figure 
derived from the theater commander’s comments disagrees with those ob- 
tained by the other methods, which is one reason for believing that it has 
relatively low validity. There are three other reasons. In most cases it was 
not the theater commander himself who da-ssified the men as Unsatisfactory, 
but the members of the assessment staff who interpreted his often brief 
comments. And, then, in making their categories the staff members held in 
mind the normal distribution curve, a practice which, as we have pointed 
out, is not legitimate in this instance. Finally, as mentioned earlier, a di.s- 
proportionatc number of “failures" appear among the theater commanders’ 
mports, because the failures were sent home and the successes retained. 
Omitting the figure furnished by this method docs not change the range of 
unsatisfactory S cases, but it does change the range of W cases. The latter 
becomes 3.5 to 6.0 per cent, which is about as low as wc might have ex- 
pected under the conditions that prevailed in the theaters, even if assessment 
had worked perfectly, presuming that we make the allowances for extraneous 
error discussed in the first section of the next chapter. 

For reasons already given we cannot place great reliance on the figures 
o tamed by the Returnee or by the Reassignment Area methods. The 
Overseas Staff Appraisal is, without doubt, our most valid method; but 
since in our various statistical computations we scrupiilou.sly limited the S 
appraisees to those (S-45 on) who had been given job ratings at the a.s- 
sessment staff conference, the number of cases on wbicli our figures are 
based is small. But if we accept the over-all ratings of tlic asscssccs belong- 
mg to Classes I to 44, which were made .several months later (July, 1044) 
on the basis of a careful examination of the S rcport.s--rating.s, personality 
sketches, and recommendations— instead of 88 we get 359 appraisees in our 
population. Now, of these 359 men assessed at S, 30 (8.4 per cent) were 
j dged Uiisatisfactory by their superiors and peers in the theater. The 
gure for W is lower, 6.0 per cent. Theiie, we would judge, are the most 
valid estimates we have, except chat the percentage for S Is probably a little 
too low, since a few men (the exact number is unknown> who were judged 
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to be moderately elfectivc at the time o£ appraisal became unsatisfactory 
later. Perhaps lo per cent would come closest to the true mark. 

Correlations between Assessment Ratings and Appraisal Ratings in 
Men Who Were Given the Job for Which Their Witness Had Been 
Assessed— The figures we have examined so far include large numbers 
of assessees who were given assignments in the theater which were very 
different from those for which they had been recommended by Station S 
or Station W. If the assessment staff passed a candidate for the position of 
radio script writer in London and, after some weeks of successful operating 
in that aiea, the man was sent to France to broadcast under shellfire, very 
close to the front, and under this strain proved unsatisfactory, he was 
counted as an assessment failure, even though it had been stated in his 
personality sketch that his emotional stability would not stand up under 
fire. Indeed, it can be said more generally that every unsatisfactory assessee 
has been recorded by us as an assessment error, whether the staff should 
properly be held accountable for it or not. For example, a large number 
of men failed because they did not have the requisite amount of technical 
skill; and, although not we but the branch administrative officers and 
their chiefs were responsible for decisions respecting technical skill, all such 
cases have been included to swell the total of our failures. 

Here wc have a few figures to indicate the order of magnitude of the 
correlations when the assignment announced at assessment and the assign- 
ment given in the theater were identical. 


TABLE 33 

Correlations between Assessment (S and W) and Returnee Appraisal Job Ratings 
for Individuals Who Had Identical Jobs Overseas, and for All Individuals 



Returnee appraisal job rating 


Identical job 1 

All cases 

Job rating 


1 




r 

N 

r 

N 

s 

•39 

31 

.19 

93 

w 

•^9 

93 

.11 



Since these computations could be made only for cases appraised by the Re- 
turnee method, the coefficients are all low. It is clear, however, that they 
are appreciably higher for men in which the job overseas was identical with 
the job for which they were assessed. These figures alone provide suffi- 
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cient ground for supposing that the average of the coedicients for S and W 
obtained by the Overseas Staff method (.45) might have been somewhat 
higher if appraisees given jobs for which they were not recomincnded had 
been omitted from the population. 


Relative Effectiveness of S Asses.sment jind W Assessment Figures 

given in Tables 31 and 33 indicate that the job ratings given after the 
one-day assessment at Station W were generally more valid than those given 
after the three-day assessment at Station S. This apparent fact is .somewhat 
surprising. Since almost all the procedures used at W were also used at S, 
the difference in validity can scarcely be attributed to W’s technical supe- 
riority, although the members of the W staff may have been more competent, 
by and large, than the S staff members. 

In seeking an explanation of the fact that our statistics do not show that 
a three-day assessment is definitely more valid than a one-day assessment, 
we might first take account of some differences between the candidates 
assessed at W and those assessed at S. Disregarding the large core of similar- 
ity in both populations, it may he said that the branch chiefs usually sent 
to S the candidates who were to be given the hardest or most hazardous 
assignments and about whose qualifications they felt most uncertain. To 
Station W were sent the highest echelons of executives whose abilities were 
etter known to the administration or who were too busy or dignified to 
spend three days solving field problems, debating, and composing prop- 
aganda at Station S. Also, almost all the women were assessed at W, most 
secretaries, and a large number of ofiicc workers, as well as many iiighly 
trained members of the Research and Analy.sis Branch, On the basis of 
these facts it is not possible to say that the candidates who went to W were 
any easier to assess. The most that can be stated is that tlie branch admin- 
istrative officers were generally disposed to send to S the men whose quali- 
fications seemed to them most questionable. Station S was the place for per- 
plexing problems That differences in the character of the assessed popula- 
tions of S and of W constitute a primary determinant of the difference in 
the percentage of unsatisfactory cases is indicaicd by the figures in Appen- 
dix A-2 Among other things, thc,sc show that 74,0 per cent of the W ckses 
were selected for a rear base assignment, whereas only 2H.7 per cent of the 
S cases belonged to this category. Of the S cases, .p.y per cent were chosen 
to operate behind enemy linc.s, but only 14.8 per cent of the W case.s were 
picked for such assignments. Thus the personnel assessed at S were destined 
to encounter a good deal more stress and danger than were the W personnel, 
n the next chapter we shall submit an explanation of why the one-day 
assessment was probably as efficient as the three-day assessment under the 
conditions that existed. Briefly it is this: nothing is gained by defining the 
p rsonahty of a candidate more precisely than one’s definition of his 
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proposed aSvSigiiinent. Since our conceptions of the different jobs were neces- 
sarily vagiiCj we could not utilize, as a rule, any more information about a 
candidate than was obtainable in a one-day assessment. A great deal more 
could be discovered about him in the longer program at Station S, but 
these additional specific facts and insights were actually of little assistance 
in deciding whether he was suitable for a given role, because we were 
ignorant of the specific requirements of the role. 

This might explain why S was no more efficient than W, but it does not 
explain the fact suggested by our figures, namely, that S was less efficient 
than W, Actually, the difference between the two coefficients of correlation 
is not statistically significant; but suppose it were, how could one account 
for it? Why should two additional days of testing, observation, and informal 
relations render an assessor less capable of judging job fitness with precision? 
Among several possible answers to this question, we shall single out one for 
comment. 

As we shall soon see, our figures indicate that the S staff was apparently 
more successful than the W staff in eliminating potential psychoneurotics, 
which suggests ilmt at S, by means of the longer interview, the projection 
tests, the stressful situations, more evidence of latent and repressed tenden- 
cies was accumulated; this material, though helpful in distinguishing neu- 
rotic or psychotic components, may have confused and impeded the process 
of reaching a clear decision as to each candidate’s effectiveness as an instru- 
ment of the organization. It is possible that having learned a good deal 
about a man, the S staff members became disproportionately interested in 
the dynamics of his personality, in his merits as a total Individual, and then 
were uncertain as to how to apply their findings to the practical problem 
of selection. Most of our present knowledge about psychodynamics has been 
acquired by clinical studies in connection with therapy; whereas most of 
our knowledge of different psychological abilities has come from personnel 
studies which put aside questions of character structure. Since these two 
branches of psychology have been developed independently, we are not yet 
in a position to relate the facts and theories pertinent to one branch with 
the facts and theories pertinent to the other, This, perhaps, defines to some 
extent the dilemma of the members of the S staff: they had a good many 
observations of exhibited dispositions and patterns of personality and a good 
many observations of different types of effectiveness, but, in the absence of 
substantial knowledge about the mutual dependence of these two kinds of 
components, they were more embarrassed than facilitated by their riches. 

Whether this is a promising line of reflection or not, it leads us to a 
strategic field of investigation which we would have passed by if the 
statistics had indicated that the validity of the S ratings was somewhat 
better than the validity of the W ratings. The discovery that our figures 
point to the opposite conclusion, if anywhere, does not bring us to the 
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practical and seemingly logical conclusion that the onc-day system is best 
and fmm now on should be used exclusively; but, indeed, to the exact 
opposite of this, namely, that the three-day system should be adopted wC 
ever possible, in order to discover through research the dynamic relations 
that conamonly prevail between dispositions and forms of character, on the 
one hand, and different varieties of effectiveness, on the other, and in order 
to tram psychologists to observe the significant clues and make the legitimate 
mferences. It would be profitable, in the long run, for us to assume that 
t e additional information obtained by stretching the screening process 
rom one to three days had diminished the validity of the final 14ions 
that this much more knowledge was a dangerous thing. But it would be 
extremely shortsighted to conclude from this\hat psychflogists shotdd to 
eek ng for much more knowledge. The three-day assessment is the path 
to that degree of knowledge which will do good rather than harm. 

CoCTelations between Assessment and AppraiKil Ratings of Traits 

on M appraisers failed to obtain ratingi 

on the different variables of personality. As checks of our assessment gradl 
we have only the records from the other systems of appraisal, ant^since 
for these the coefficients of correlation on job ratings are all low there is 
ittle reason to expect higher correlations between ratings of traits since 

msults of our computations are given in Table 3 .]. Examination of these 
figures reveals (i) that all coefficients, except two, arc positive, though most 
of them are of very low order; (a) that Effective Intelligence is the v-lrhble 

^ S (3) that, in general, the validity 

of S ratings is no higher than the validity of W ratings ^ 

Comparing the various coefficients for S and for W, we find certain indica- 

Effective IntJlL ^ on Motivation and 

Effective Intelligence and lower on Emotional Stability and Lcadershin 

Both stations were equally inefficient, as measured by these very question 

able figures, when it came to judging Social Belntionl ^ ^ 

findings could scarcely have been anticipated. We might have 

f a rule he' ' '""'Ta T at both S and W would 

as a rule, be more valid than the ratings on other variable.s, largely because 

psychologists have applied themselves for so many years to tht study the 

todd be dTff general mental abL'y. But, asm^-ng t’h^ 

w uld be differences in validity between S ratings and W rating.s, wc would 

pnee, because the standard tests were administered as well at W as at S 
toj eta, eta S eoe«ci»,. „„„,d ta hiBhee on E^orionTsenbl So i 
Relations, and Leadership, because the three-day country situatiL at S 
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had been designed primarily to test the strength of precisely these attributes 
of personality. Although the figures we have here do not provide us with a 
reliable basis for speculation, certainly they do not indicate that the S staff 
was more sueeessful in judging these important traits than was the W staff. 

If it were true that the S staff was not more successful than the W staff 
in this part of its undertaking, we would have another reason to pursue 

TABLE 34 

Correlations between Assessment and Appraisal Ratings of Personality Variables 
for Various Appraisal Methods 
{S fisnres arc for Classes 8-4^ on; W figures are for all classes) 




Methods of appraisal 


1 


Variable 

Theater 

Commander 

Reassignment 

Area 

Returnee 

Median 


s 

w 

s 

W 

s 

w 


Motivation 

Effective Intelli- 

.14 

.08 


.10 

•15 

.OL 

.11 

gence 

Emotional 

•33 

.09 

.30 

.xo 

•53 

•35 

• 3 ^ 

Stability 

-.14 

-.07 

, 12 . 

,18 

, 0 J 

■13 

.08 

Social Relations . , 

.10 

.00 

.10 

, 0 i 

.00 ' 

• 2-7 

.06 

Leadership 

.11 

. 2.0 

B 

a 

.11 ! 

.30 

.16 

Median 

.11 

.08 

.16 

.14 

.11 

.17 



* =A/ insufficient. 


the course of speculation suggested in the last section. As one of several 
hypotheses, for example, we would suggest that the members of the S staff 
were likely to lower their ratings on Emotional Stability, Social Relations, 
and Leadership whenever they discovered (in a candidate's personality) 
memories of childhood traumata and evidences of repressed tendencies com- 
monly associated with neurotic illness. This action would have been reason- 
able since in the history of psychology such components have been studied 
almost solely in this connection. Little is known of their incidence and 
influence in highly effective people. Since many fewer of these latent or 
suppressed elements are exposed during a one-day assessment, the members 
of the W staff might have been less confused in the process of arriving at 
their final decisions. In the absence of substantiating data it would be idle 
to develop this notion any further. 
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Evaluation of Certain Test Procedures — P,y the incthoci of Returnee 
Appraisal it was possible to get respectably large [uipularicms on which to 
compare Effective Intclligeiice rating, S‘ with the ratings given at Station S 
on each of the separate tests of this variable. These rorrtTuifins arc shown 

TABLE 35 

Correlations between Ratings on Effective Intelligence from Various IV(>ctulures 
at Area S and Returnee Appraisal Ratings o\\ Ktftviive huelligcncc 

(Cliixses on) 


l‘i!c:ccive Iiuijlli^icncc 
Rcnirace 

' N 


Interview . . . 
Discussion . . 
Debate 


Non-Verbal Battery (Matrix Test). . . 

Vocabulary Test 

Mechanical Comprehension Test 

Judgment of Others 


Final Effective Intelligence 


in Table 35, There is nothing noteworthy in these rignrcs. Wc nine merely 
that the coefficients for the Interview and the two siiiialinnal tests are a little 
higher than the coefficients for the papcr-ancl-pcncil tests. As valitlatcd by 
these dubious Returnee ratings, the Mechanical Comprehension Test corre- 
lates lowest of any procedures. It is fairly clear that this test measures a 
notably different skill from the other tests of intelligence --a skill that differs 
from what respondents in the Returncx Appraisal tcdini(ni(; inciini by 
Effective Intelligence. Ihis low correlation agrees well with the findini’ 
made at S that this test of mechanical compreliensittii correlated poorly 
with the other components of the Effective Intelligence battery. 'I'lie S final 
rating on Effective Intelligence correlates a little better with the tijiftraisal 
rating than does any single te.st of this variable. 

Neuropsychiatric Screening.-A brief study was made of neuropsychiatric 
breakdowns among OSS personnel as reported in tltc reconls of the Medical 
Branch. This branch was entirely independent of the Assessment Unit. 

The total number of persons who served in OSS was never precisely 
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! U 
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; 71 
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1 «7 
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EITective Intelligence rating,s, 
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figured. The best figure available is 20,000, which is probably correct within 
10 per cent. Out o£ this group, which includes the 5 j 39 ^ personnel assessed 
at S and W, there were 52 neuropsychiatric breakdowns according to the 
records of the Medical Branch. These 52 include all recorded psychotic and 
psychoncurotic disabilities which developed acutely and were sufficiently 
severe to cause the individual to be removed from duty. This represents 
0.26 per cent of the total OSS population. 

Of those personnel who had been assessed at S, numbering 2,372, 2 were 
included in this list of the Medical Branch. One of these individuals had 
not been passed by S, because his neuropsychiatric condition was recognized. 
He was retained in the organization, however, despite the decision of the 
S staff. The other person was recommended with great caution, with the 
condition that he be watched carefully at training centers and used only if 
the doubts which existed in the minds of the assessment staff appeared un- 
ju.stified to his instructors after they got to know him well. If we consider 
this cautious acceptance as an error 011 the pan of the S staff, then 0.04 per 
cent of those assessed at S were neuropsychiatric breakdowns, as compared 
with 0,26 per cent of the total population. If we do not consider this to be 
an error, the percentage for Area S was 0.0. 

Of the 3,071 candidates assessed at Area W, 7 developed neuropsychiatric 
breakdowns. One of these was not approved by Area W because of emo- 
tional instability, but 6 were approved. This is an error of 0,20 per cent, 
which, though highcjT than the S rate, is still lower than the percentage for 
the whole OSS population. 

Evaluation of a Test Battery for a Specific Purpose.— The assessment 
staff was approached by an administrative officer of one of the branches of 
OSS with the hope of finding some test or series of tests which could be 
used to select for intelligence work candidates whose chief function would 
be to observe and report enemy order of battle. The staff responded by 
requesting the officer to make two lists of agents who had served in his 
branch. One list was to be made up of those distinctly good in observing 
and reporting the order of battle, and the other of those who were definitely 
bad. It seemed impractical to attempt to distinguish more than two degrees 
of this ability, very good and very poor. The list was prepared according to 
these directions by officers of the branch. The members of the assessment 
staff played no part in the selection. 

Twelve good observers and reporters were named, and 16 bad. The 
first fact discovered was that all twelve of the good men had been assessed 
at S. All had been passed, with the exception of one man, who at the time 
of his assessment was being considered for an entirely different mission. 
Their Over-all ratings had averaged 3.25 on the six-point scale. Only five 
of the poor observers had been assessed at S. One had been assessed at W. 
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The other ten had not been assessed. All six who had gone to assessmf'nt 
centers had passed. The ovcr-all ratings of the fivc\vho aS 
averaged 1.9. 

The comparison of these two small groups was continued by coinnilino 
all the ratings for them in the Effective Intelligence battery and the Observ- 
ing and Reporting battery, and the average score on the six-point scale for 
each test was determined for the good oliscrvcrs and for the poor. Table 36 

TABLE 36 

Mean Ratings on Effective Intelligence and Observing and Rcjiorting Tests for 
Assessed Groups of Superior and Inferior Observers 


L Effective Intelligence 

Interview 

Vocabulary 

Nonverbal Battery 

Stress Interview 

Discussion 

Debate 

g. Mechanical Comprehension , 

h. Practical Judgment 

i. Brook 

j. Judgment of Others 


a. 

b. 

c. 

d. 

e. 

f. 


Mean. 


IL Observing and Reporting. 

a. Interview 

b. Belongings 

c. Terrain 

d. Brief Case 

Memory Battery 

Names and Identities, . 


SnjX!rior observers 
m I N 


3-9 

3.6 

3- 4 

X.6 

3‘0 

3*4 

3,8 

4- 0 
4.0 
3*^ 
3*4 

3-5 


e. 

f. 


Mean. 


3.0 

4.0 

3*4 

3.0 
3*0 
1,3 
1/5 




JO 

7 

3 

3 

3 

5 

5 

5 
1 

6 

5 

55 


Inferior observers 


9 

1 

8 

7 

8 
6 

45 


m 

j N 


. — 

3 ,0 

5 

3*^ 

3 

^•5 

4 

^•5 

4 

X.7 

} 

1.0 

4 

1.0 

3 

1.7 

4 

^*5 

X 

1.8 

5 

1.7 

3 

1.4 

42- 

Z.8 

5 

z.o 

I 

1.8 

5 

Z.l 

5 

z.o 

3 

3*4 

5 

3.Z 

3 

Z.6 

19 

> make 

up e.ich 


.nuws me result, ihc number of individual tests eoinr 
mean score is indicated in the column after each score. 

r ft,- ^ difference between the two groups for every 

higher test scores. The mean for all the test results of the good 
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observers^ a total of lOo individual tests, was 3'3* the poor observers 
the average was 2.5 in 71 tests. The difference between these two means is 
significant beyond the i per cent level, the probability being less than 2 in 
1,000 that these results could have come by chance. 

This little study is not in itself very impressive because the size of each 
group is so small However, it is as complete a roster as could be obtained 
of all the men who did this sort of work in this branch, and it was not 
selected on any basis except the ability to observe and report enemy order 
of battle. 

CLINICAL EVALUATION OF THE ASSESSMENT OF A SMALL 
SAMPLE OF CASES 

The selection of men consists of two tasks, arriving at diagnoses of the 
personalities of the subjects and making prognoses of their effectiveness in 
assignments. The basis for both of these judgments by the assessment staff 
is better revealed in the written reports on the candidates than in the arrays 
of final grades that were assigned to them. An individuals characteristic 
patterns of adjustment, his personal motivation and desires, his special 
liabilities and distinctive assets are poorly represented in numerical ratings. 
In the Returnee method, for example, the informant’s appraisal was pre- 
sented much more adequately in his comments than in his raw scores. It 
was therefore decided to supplement our statistical appraisal studies with 
the less quantitative procedure of comparing the written assessment reports 
with the comments of the Returnee Appraisal informants. These were 
more comparable to the original assessment reports than any appraisal 
data except the Reassignment Area reports, and they had the advantage 
over the latter of being free from the interpretive distortions contributed by 
the assessors. It was hoped that this study would yield more than an indica- 
tion of the relative number of assessment successes and failures, since it 
would also suggest some of the reasons for failure. 

Our analysis was restricted to a rather small number of cases (36), since 
this was the total number on which the following materials were available: 
(i) the S report; (ii) the Returnee Appraisal protocols with detailed com- 
ments and ratings considered sufficiently complete to warrant a high re- 
liability rating, Tlic cases which met these two requirements were a rather 
selected population, chiefly because high reliability ratings were assigned to 
those cases for which the staff had clear-cut pictures, which naturally were 
obtained most easily for individuals who were either very good or very poor. 

Since twenty-four out of the thirty-six cases in this study were In the 
classes before S-45, they had no job ratings. Such ratings were assigned by a 
staff member for the purposes of this study after reading the report and 
the ratings on the variables. 
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All of the cases presented in this study are S cases. Two thirds of them 
were assessed before Class S-45, and one third after Class S-45. Therefore 
the population ^ for this study, like the total Returnee Appraisal group 
cannot be considered representative of the S population. It is too heavily 
loaded with cases from early classes and also excessively weighted with 
cases which received a short period of assessment, having four times as 
high a percentage of these as the total S population, 

The procedure of this experiment was as follows: 

Two groups of judges, each composed of three staff members, were se- 
lected to make the comparisons between the S reports and the Returnee 
reports. Each judge made his decisions independently of the others on his 
team. The team members followed these instructions 1 

Please read the S report and decide if the picture that you have of the eandid.ite 
frorn the report is complete or incomplete. If it is inadequate, then write the 
candid.ites name under the heading, "Picture very incomplete.” After havinc 
made the above decision, read the Returnee reports. The picture that you cef 
of the candidate from these Returnee reports is the criterion against which vou 
are to appraise the S report. Tlien decide, with reference to tlie criterion, wliich 
or the categories listed below describes the case most adequately. 

1) Diagnosis and prognosis both essentially correct. 

2) Diagnosis essentially correct, prognosis partially correct. 

3) Diagnosis essentially correct, prognosis essentially incorrect. 

4) Diagnosis partially correct, prognosis essentially correct, 

5) Diagnosis partially correct, prognosis partially correct. 

6) Diagnosis partially correct, prognosis essentially incorrect, 

7) Diagnosis essentially incorrect, prognosis essentially correct. 

8; Diagnosis essentially incorrect, prognosis partially correct. 

9) Diagnosis and prognosis both essentially incorrect, 

adopted for the terms used in these directions were as 


Diagnosis the description of the main personality varialiles, 
rognosis = the evaluation (explicit or implicit) of the factors included with 
reference to effectiveness in the proposed .isslgiimcnt 

"" ® "p"" -'k <k= 

_ Of the thirty-six cases, half were rated by each team of juclgc.s When 
atse £1° that de '' 

fell, that decision was considered final. Cases in which three different 
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decisions were made were classified as disagreements. Cases in which in- 
adequate data were available for judgment were classified as incomplete. 
The results of this procedure are presented in Table 37. 

TABLE 37 

Cases of Special Study Grouped in Categories of Correctness of Diagnosis 

and Prognosis 

I. Diagnosis and prognosis both essentially correct 

z. Diagnosis esseiitially correct, prognosis essentially incorrect z 

3. Diagnosis essentially correct, prognosis partially correct ! , ! . ! i 

4. Diagnosis partially correct, prognosis essentially incorrect i 

5. Diagnosis and prognosis both essentially incorrect i 

6 . Incomplete q 

7. Disagreements ' ’ ^ 

After these classificaLions had been made, the raters were asked to make 
some judgment on the incomplete cases, even though the evidence was 
inadequate. They were requested to base their decisions on the overtones 
and implications of the records. These nine cases were then placed in what- 
ever category was chosen by two or three members of the team. The five 
cases on which there were disagreements were also reviewed by two addi- 
tional staff members acting as referees. After reviewing the data, these two 
decided which of the three different categories checked for each of the 
cases described it most adequately, and this was its final classification. The 
dispositions of the incomplete and disagreement cases made in this second 

TABLE 38 

Cases of 1 able 37, Including Distributions into Categories of Incomplete Cases 
and Those on Which There Were Disagreements 

Accunicy of diagnosis and prognosis Agreements Incomplere Disagiee- Total 

mencs 

I. Diagnosis and prognosis both 

essentially correct 

X. Diagnosis essentially correct, 
prognosis essentially incorrect.. . 

3. Diagnosis essentially correct, 

prognosis partially correct 

4. Diagnosis partially correct, prog- 
nosis partially correct 

5. Diagnosis partially correct, prog- 
nosis essentially incorrect 

6. Diagnosis and prognosis both 

essentially incorrect 
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step are presented in Table 38, combined with the data presented in 
Table 37. 

From these totals it may be concluded that Cfj.y per cent were successes 
II. I per cent were failures, and 22.2 per cent fell between thc.se two extremes, 
The data of Table 37 may be regrouped as in Table 39. 


TABLE 39 

Cases of Special Study Grouped in 'rerins of C'orrcctness of l)iay;nosis and 

of Prognosis 


Diagnosis 
essentially cocrect 

30 

Prognosis 
essentially correct 

2-4 


Diagnosis 
pjircially correct 

X 

Prognosis 
partially corrccc 

1 


Diagnosis 

eHentially incorrect 
4 

PrngrKJsis 

csheiitially incorrect 
10 


This table indicates that a somewhat better job of diagnosis than of 
progno.sis was done on these cases. This result is un<ler.standahlc in view 
of the fact that throughout most of its liistory tlic a.sscssment staff liad no 

)ob analyses or real knowledge of field conditions in terms of wliicli elTcctivc- 
ness could be judged. 

Having learned thc.se facts we proceeded in an attempt to discover the 
reasons for our complete and partial failures. We studied all the ca,scs except 
those in which both diagmosis and prognosis had been considered essentially 
correct on first examination by the majority of judges. This gave us a group 
of twenty cases. ^ ” * 

The first question we attempted to answer was: What significant aspects 
of the candidates personality and behavior were neglected or undcrempha- 
sized at assessment, and which ones were ovcrempliasized,? To find an 
answer to this question two staff members compared paired S reports and 
eturnee reports, noting those differences between the two wliich stood out 

w’lctlicr they were errors of diagno.sis or of 
progno.sis. The results arc listed in Tabic 40. 

staYcpI' nM one instance of emotional insiahility and two in- 

ro s In d . or underernph:isi.s repre.sent 

errors in diagnosis rather than m progno,sis. It .sliould not be understood th.it 

severTwnn°"^'’{r whatever to tlic traits in question. In 

Tsc iitlofoTr charactristics is citl.er im ilicit in the 

^ <=^od.date, or is mentioned without emphasi.s. In almost 

ouenr n T u manifclted in the subse- 

q ent performance have been guessed from the report. Two of the three 
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exceptions were cases where the candidate’s poor effective intelligence was 
clearly seen by the interviewer at assessment, but not given enough weight 
in the evaluation of his fitness for assignment. 

With very few exceptions (cases of “strong drive” and of “shrewdness”), 
the characteristics overemphasized were actually typical of the persons to 
whom they were ascribed. However, either they proved to be less significant 
for the candidate’s success or failure than was anticipated, or they did not 
operate in the expected direction. Thus the overemphases in our sample 
of reports represent failures not of diagnosis but of prognosis. 

TABLE 40 

Aspects of Personality Incorrectly Assessed in Cases of Special Study 


Aspect of i>€rsonality 

No. of cases in which 
aspects were neglected 
or iinderemphasized 

No. of cases in which 
aspects were 
overemphasized 


In diagnosis 

In prognosis 

In diagnosis 

In prognosis 

Emotional instability nr 
immaturity 

4 

I 


3 

Poor social relations 

3 

— 

— 

— 

Extraversion, social facility,. 


— 

— 

4 

Egocentric motivation 

3 

— 

— 

— 

Strong motivation 

— 

— 

— 

1 

Low effective intelligence — 

I 

% 

— 

— 

Effectiveness, shrewdness 

— 

— 

I 

1 

Low integrity 


— 

— 

— 

Strong drive 

— 

— 

I 1 

3 

Past accomplishments 

— 

• — 

— 


Possession of special skills. , . 




I 


It may also he concluded from Table 40 that the place of emotional 
stability in the whole personality configuration is difficult to assess and that 
the asscsstnent staff tended to overvalue some energetic, extraverted persons, 
and to disregard egoccntricity resulting in bad social relations. 

In order to answer the question of what kind of people assessment over- 
valued and which it undervalued, we compared our 20 S reports with their 
corresponding appraisals and divided them as follows: definitely under- 
valued, 3; slightly undervalued, 5; definitely overvalued, 8, slightly over- 
valued, 4. 

Of the three who were definitely underrated^ one is described in the S 
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report as "intelligent and perceptive.” "a man of many superiorities .f 
character and experience, but with considerable feelings ll: inferioritv and 
a considerable load of anxiety.” The report add,s, hovvever, that in cridcal 
situations this man may be counted upon to manage his an.;ie.v A d 
report on the second man underrated dwells on his vagueness of purn 
and lack of clear.ut attitudes, interpreting them as signs orcmclma i:! 
ma urity. iis man would have been failed in asjtcssment were it not for 

Wi 1 ‘’'«">-y of asthma and mignine 

decides that they are not indicative of emotional instability a ml , Z! ’ 

i Zrto brvtdi'art f thoughtful habit, who is b! 

ed to be vvell adapted to service ovcr.sca,s.” All three men later dul 

xcellent jobs abroach earning highest praise for their pcrformancc.s, the first 

Z ^t'hniniltrator. The S repZ! 

them incom[)Iete) and oie of 

them (the last) is not very illuminating, giving no inkliriLr -u all of d,« 1 

libles, most of which were above averairc in nil n 

reporuyare clefinitdy favorable to the candidates. Wliile they do notion- 

a equate indications of these men’s actual excellence the extent of 
underrating was by no means extreme. 

For all five of the cases that were s/iffMy underrated tlie reports -ire slinrt 

”iw nlrwrirT' 

.-rxe =; 

liig!”<»plratih'°!d”ar" “"‘'"m"” “ hard wnrit- 

made a hiVblv ^ psychological .stamina iintlcr stress,” This man 

considerable feelintr nnrl b '^' y^' ^ heat, capable of 

controlled, (riendlv in, ,f ''I'’'' ."'•'id' »|i|icars entrcmcly well 

approprinte ZdS, > a n*tore „f f,,„k „,,enne,,, and 

appea a ro bT” Zl'roi '’f , ” “pondbility . . , 

adintant, Id iiaZ t for haaardott, roi„i,„„," Thia man became an 

of the iob and''aLt ''^■sphosibility. his expert handling 

enl aZ roin aZ The e ' »“1 tela, Iona with' offieera and 

men alike. The S report on the fourth candidate contains the fol- 
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lowing statements. ... an unusually penetrating and analytical mind 
which is bulwarked by a remarkably wide and varied body of knowledge. 
He has keen critical judgment. He is emotionally stable and fit for overseas 
duty.” l‘his man in a short time became an outstanding political analyst. 
All of these candidates earned superior, or very superior, job ratings in the 
field, and, what is more, the directions in which they excelled were con- 
sistent with the assessment observations. Thus the S reports, in spite of 
their largely descriptive nature and their incompleteness, captured the essen- 
tial assets of each case. The ratings on variables are in all these cases con- 
sistent with the written characterizations. The only reasons why these cases 
can be considered slightly underrated are, first, the fact that the reports do 
not mention all of each candidate’s pertinent assets, such as the good social 
relations of the secretary, the energy and leadership ability of the security 
officer, or the writing ability of the political analyst, and, second, that the 
favorable conclusions are often couched in rather cautious language. This 
is partly accounted for by the fact that two of these four cases were given 
only short assessments, and consequently were not observed in very many 
situations. 

The hist slightly underrated case was that of a physically handicapped per- 
son with many additional physical complaints. Doubting his energy, intelli- 
gence, and particularly his emotional stability, the report seriously questioned 
the desirability, of sending him overseas “unless he has some special talent 
which is impossible to duplicate.’^ A low-grade technician, he was sent 
abroad despite the assessment counsel, and, within limitations of his handi- 
cap and his ability, did an adequate, conscientious job (Job rating 3), adjust- 
ing well to situations of stress, including bombing. The picture given by 
associates does not contradict the conclusions reached at S, but indicates 
that the candidate had methods of handling his emotional conflicts that 
even made him a social asset (“the office wit— his humor not barbed— 
directed at himself— raises others’ morale.*’) His co-workers liked him as 
“just a fellow who did the best with what he had.” This case was also one 
of brief assessment, While the interviewer saw the problems and limitations 
of this man, he did not in the short time available observe the methods by 
which he was able to counteract them effectively. Since, even at that, the 
job he was able to do was merely average, the undervaluation in this case 
can also be considered as slight. 

Altogether, undervaluation, as revealed in these eight cases, does not 
appear to be a serious shortcoming of assessment. 

No generalization seems possible about the \ind of people that were under- 
estimated. They ranged from a self-sufficient, conscientious, somewhat aloof 
intellectual to a “colorful extravert.” It is conspicuous, however, that in 
four out of these eight cases, including all three cases of definite under- 
valuation, the main reason for undervaluation was the suspicion of emo- 
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tional instability. For the re.st, uiulcrvaluation seemed to be rchited neith. 
to any factors in the candidates' personalities nor to assessors’ leT t 
rather to extraneous factors like the shorfnftcc nf . ' ' but 

also to the ntmllingness of interviewers to a.mmit'Inrivc'u! e^S^ 
formulations. Ihe importance of .situational observations is emnlH«'- i u* 

ments made m the interviews. ^ ^ '^rc valid than judg- 

iSSZSSSSF- 

and the main reason for their failures on T \ ^ 

centric motivation, coupled with ruthlessL a d f \ 
pursuit of their goals o? profit „ 1 ' O^c tlie° 

mmmm 

P““P ™''- W'f ™in 

the wording o£ *ere report, i, noneommiLl (care^nC^^^^^^ '""TS'' 

^‘iS^LtSeTrtarTo'''’ P^hTSom' 

the candidates- self-dcscriptions 

clearly ^at^chamTSicrofth fh^iy indicate more 

in the minds of their shortcomings 

these defieiencieV. 

what unconventional sort ^ -- ptomoier of a some- 

nance .,,,-' “to some extent’riulilcss [ , "''"‘csted in sclf-maintc- 

other report speaks of the candidiit^ \V “pos e s S^Jh^ i^iM T" 
persona lty,” as ‘‘imoelled Kv Me possessing the ideal salesman’ 

up . . . .-’ and L Cer aitlo , '^o ‘ ^’t.ild himself 

his past breaches of discipline and''nMT '''' ''fU'temcnt.” It also mentions 
risk. In both assess r 'of ^i poor security 

overshadowed by favorable remarks negative comments are 

thusiasm.Thecandi;e i! d"cX^^^^ ' " 

of social situations,” yet friendlv and ^^^liistic manipulator 

ns, yet triendly and generous; praised for “the unusual 
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objectivity with which he appraises himself" and finally epitomized as a 
“calm, confident, tolerant but nonetheless determined and persistent [person 
who] seems almost ideally suited for the work with natives;* The report 
on the second candidate emphasizes his ^outgoing, affable, frank, unin- 
hibited, gregarious nature, his good humor, alertness, and emotional stabil- 
ity* These descriptions are not wholly incorrect, for the first man demon- 
strated great courage, and both were thought by some to be good company. 
However, the first is said to have earned the hatred of all enlisted men, and 
the general consensus about the second was that he was a “conceited, licen- 
tious, obnoxious braggart;* 

One cannot help feeling that in these cases the staff members fell prey to 
the candidates* salesmanship and were unduly impressed by their tough- 
ness, extraversion, and freedom from inhibitions, interpreting symptoms of 
psychopathy as evidence of superior emotional stability. With their generally 
positive orientation, the S reports seem also to have overestimated these 
men*s shrewdness and effectiveness. Three of them, rated high on intelli- 
gence or resourcefulness at assessment, are described by their colleagues, in 
one case as “stupid, flighty, always messing things up"; in the second as 
"not very bright," “relying on others to dc his mental work for him,” 
"being taken for a ride”; and in the third as "unable to see another person’s 
point of view.” The primary source for their failures, however, was in the 
area of motivation rather than intelligence. 

The failure of the next group of four cases of equally extreme overvalua- 
tion resulted from emotional instability or immaturity, which was not clearly 
seen or was slighted in assessment* The group consists of one man and 
three women, the women being by far the graver failures. One of them 
was returned because she was habitually confused and erratic to the point 
of being completely ineffectual. Another, under the stress of rocket bombing, 
became a ’‘nervous wreck” and finally decided to return to America. Both 
these women are described by associates abroad rather sympathetically as 
well-meaning and conscientious, even though their extreme emotional insta- 
bility which reduced their efficiency was obvious. The emotional disturbance 
of the third woman manifested itself less by inefficiency than by indiscreet 
and tactless social behavior which continually got her into difficulties. This 
girl was also eventually returned to the United States before completion 
of her assignment. The man in this group was described as "sophomoric,” 
given to dramatic poses, unable to take responsibility for any decisions, and 
generally inviting ridicule. However, the opinions varied considerably about 
the job he did; averaging the widely disparate scores yields an unsatisfactory 
rating* 

The S reports on these four cases are short, two of them being based on 
brief assessment. The reports on the three women contain some material 
that might suggest emotional difficulties. Of the first it is said that “her per- 
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sonahty is difficult to evaluate, since there is evidence of oood acenmnU u 
ment in spite of some emotional instability." The second is described ? ‘f 
^unusual character . . . whose cautiousness and reserve make it difficult to 
gam more than a suiierficial knowlctlgc of her background." The rennrr 
die third mentions her unfavorable childhood and her rather unstable "oA 
history. Hoover, only i„ the first ca.se was a tentative diagno of !!? 
tional instability made as a result of which it was rce.ommLlcd that ffit 
canffidate be observed fiirthcr before being considered for overseas .service 
In the other two cases, the emotional instability was not clearly seen 
The assessment of the second woman w-as influenced in her favor by her 
quality of individual integrity" and particularly by the extremely stroncr 
mottvanon wluch she displayed at S. These charLteristics of the elndiclaJf 
later fully cMfirmed by her associates, made it possililc to interpret the signs 
of eccentricity and social isolation which appeared at assessment as self 
fmmr'^ independence, an interpretation which her subsequent per’ 
formance proved to be entirely faulty. This failure of psychological anilwis 
is partly explained by the candidacc’.s reluctance, or iiiabilky, to kt the inter 

oTn^l aZd^ -"oi 

No such reserve was di.splaycd by the third woman, who imf5rc,s.scd the 
ntcrviewer as having "a pleasant, friendly manner" and who gave him the 
impression of getting along well with others. Yet her assessment represents 
yen a greater failure of p.syehologieal analysis, since it seems t i c 

xamn? 'rh «'lf-fliu-c:ring generalisations aliout hersd^For 

to T'- as that "her job hi.story seems 

to be more indicative of an interest in new experienees than of instabilitv" 

and hat in .spite of her unhappy childhood .she. is today a svcll-integnted 
emotionally stable, and mature person." The case resemhlertlmr b die 

- p- - 

Srordii: “ir Ke.«raIisations. Tile unrvLtfu?;:! 

disturbance appear^ in the report. ‘ 

stability are chieflv”faniir*'^^"^**T' "’^tltxiiiaicly diagnosed emotional in- 
analysis bevond L ' -r ' ’7'.' psychological 

Xc FacC rW adf-descrip!ions of the 

relations and on the ^ inotivation, and of facile social 

relations, and, on the other, the paucity of relevant interview material re- 
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suiting from inhibitions, reserve, or lack of insight on the part of the 
candidates. 

Ihe remaining four cases represent insiaiices of less serious overvaluation, 
though three of them did an inferior job. 1 wo of them are rather similar. 
One man is described, in a rather full report, as a person “with few faults 
and few exciting qualities,” a “nice fellow” who lacks both ambition and 
mental agility, but whose “great capacity for inoflensiveness” enables him 
to get along '‘by being pleasant and conventional,” The past history of this 
man is consistent with this picture, containing some indications of ineffective- 
ness, but none of complete failure. Of the second man it is said that he 
“describes himself in terms of almost perfect, but colorless normality,” 
“offers little evidence of emotional play or of creative imagination,” and is 
unable to elaborate his reports of concrete events and accomplishments. 
Like the first man he was rated Average, or Low Average, on most variables, 
yet approved without question. Both men were subsequently given adminis- 
trative jobs as intelligence officers and both failed completely. The failure 
of the first man was accentuated and made more extreme by an emotional 
upset caused by the loss of two relatives in the service, but this was not 
the primary cause of his failure, He was described by his associates as a 
“charming gentleman” and “as ineffectual as a man can be”; wishing to be 
helpful, but dull-wiucd and incapable of doing his job; “harmless but use- 
less.” The second man was described in very similar terms as a “kindly, 
neighborly chap,” well-intentioned but stupid and slow, a plodder capable of 
only the simplest routine work under constant supervision. These pictures 
are consistent with those given in the S reports. The assessors saw the 
limitations of these men, but treated them with undue leniency. When the 
interviewer, writing about the first man, concluded that “he still has enough 
on the ball ... to do a job , particularly if his talents in social relations 
are capitalized,” he unwittingly proved the truth of his own immediately 
preceding remark that the student’s manner inspires more confidence in 
him “than is justified by his abilities.” These two cases, then, might be con- 
sidered as failures in prognosis rather than in diagnosis, failures caused 
partly by overvaluation of good will and of social relations. 

Of the remaining two cases, one man is similar to the two preceding 
ones in that his failure on the job was due primarily to lack of ability for 
which his good motivation, hard work, and sincerity proved unable to com- 
pensate, In contrast to the other two, however, this case cannot be considered 
one of overvaluation in assessment. The S report not only gives a balanced 
picture of the candidate's assets and liabilities, a picture which Is based on an 
insightful analysis and which was confirmed by associates in every single 
detail, but also draws the appropriate conclusion that his proved special skills 
can be utilized, but that he “should not be used in a job where his intel- 
lectual limitations and his difficult social relations would be exposed,” How* 
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ever, in an emergency he was nKnic comnK.n,)mg o,rner „f a , 

dter an mtclJigcnce officer, and failed completely in Imih ir,l,r 
intelligence was nil"; "he almost hrokc Ins nc!k jvi n ,!?‘*rftical 
thought they should have,” hut did not show "d.^liKhtclrun I* 
of people,” with the result that he antagoriiycd them n.ul 
.bic du, Thi, c,,c i, r;; 1 ; 

dcm.o„ comr»,y ,o ,h, drf„i,c ,c„, „ , 1 ,,; “ , ' ‘ 

rhe last member of the overvalued grtnip is •, linm.i Cl 

intense interest in Jiis work " "a teiKf iiulm' I , i t • , . ‘"’h' tl>'ivc and 

up, y=, bu able m bmdlc'his nemm, 

share no.K of hi, i„W« Lid™,",!; n ' “““ 

obstinate, and generally c)bno.xious Il- 't "screwball,” 

people he taught, and. While amda.uu'ngf^W.f a?W 
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who might break down under stress. This concern is reflected, in our sample 
of reports, in a tendency to undervalue the candidates who showed such 
Indications of emotional instability as indecision, anxiety, depressed moods, 
and psychosomatic symptoms. Indirectly, the same concern is revealed in 
the overvaluation of vigorous, outgoing, uninhibited people, one reason for 
overvaluation being that their behavior was interpreted as indicative of 
good emotional stability. Of the three individuals in this group whose pro- 
nounced emotional instability we failed to diagnose and who failed on the 
job primarily because of this defect, only one was inhibited, eccentric, and 
withdrawn; the other two were active and outgoing. In the case of the 
woman who later developed anxiety under bombing, emotional instability 
was recognized at assessment. All of these findings seem to indicate that, 
intent as we were upon discovering symptoms of instability, we were more 
sensitive to anxiety or compulsion neurosis than to hysterical character or 
psychopathy. 

Social Relations, though important in determining our judgment of the 
candidate, seems to have been of less concern during the period covered by 
these reports than was Emotional Stability. There are few explicit discus- 
sions of poor or questionable social relations in these twenty assessment re- 
ports, On the other hand, the characteristics of the candidates that led to 
e/Tectivcncss in social relations seem to have concerned us less as a potential 
disability than as a potential asset. As such they occasionally outweighed in 
our eyes the recognized limitations of the candidate, such as lack of effective 
intelligence, lack of integrity, or low emotional stability, and were respon- 
sible for overvaluation. Actually, over a long period of time the social rela- 
tions of these people, though active and facile enough, proved to be so 
poor that they led to their rejection by associates and contributed greatly 
to their failures, The chief flaw in our consideration of social relations seems 
to have been a failure to differentiate between the mastery of social skills 
and the possession of genuinely positive attitudes toward others. 

In the field of Motivation a very similar situation seemed to prevail. We 
considered strong drive and high motivation as definite assets, but paid 
relatively little attention to the direction of drive and to the possible pitfalls 
of strong motivation. The primary reason for the failure in the field of our 
most overrated candidates was the fact that their strong drive was primarily 
egocentric and turned them to pursuits that often were opposed to the in- 
terests of the organization. 

In considering this evidence of the shortcomings of our diagnosis and 
prognosis one mUvSt keep in mind two pertinent points: first, that these 
generalizations are based largely on an analysis of our failures in the early 
period of assessment; and second, that the picture presented in the sum- 
mary has been overdrawn in order to bring out significant points. Actually, 
in many of the cases described, the shortcomings were caused less by our 



448 


Assessment of Men 

preconceptions and biases than by extrinsic circiimst-mree Tn 
the superficiality of our analy,scs\vas due to the sliortness ofT^ 
assessment, which also made it unffisihl/< o, t i 

•social relations as they developed after t'te Initial iStlnarlf mTlf 
of him, I„ ,he l,,or priocl „f 

crcMiy, ,ho .hop, i'lnriv; ; 

no too «.oo,ly than tha, i„,„|„,| ij i,„ emnti „ * 

t ' S 

oktlvdy antwnmd. thorn j„„,| " ITm Irfm^TinTo'ir" “a 

CONCLUSION 

.h='"n»„,lirt™o'*ii ::t'f 

been reported. We have seen tint 'i* ' "htained, have 

appraisals with assessments the' ^ <'f eomparlnp 

as well defined in operadokal tea'll ns Salitn^ 

by rTnTulI’l^hrtlf Icsf ore 7"'’''' miared 

unit, we erred in nmlkilTorn ^ 7 

No member of the staff then bn validation aStudies. 

ganiaing a atom “ ' 'T "' “* “'- 

time for anything but a makeshift Thn""^. ‘h there was na 

Standard for evaluating our work and at X an adequate 

valley of uncertfiinty. ' ' spciilating in the 

others to ‘^oncentraL 

difficult than th.at of aL s JIn ^ ‘ ^ is more 

praisees operate are more varied’ inT alp 

tion, and the performances of appraisees arc lilkwis 7 

achievementslss unher!lde7and a irPt l’'"'" 

rations. An adluate svstem nf ^ momcni make bubble repu- 

quate system of appratsal must rest on clearly defined criteHa 



The Evaluation of Assessment 449 

of merit arrived at after an analysis of environments and jobs. The task 
calls for a thorough study of field conditions. 

Since the criteria of appraisal define the standard against which the 
efficacy of assessment will be measured, they constitute the target of predic- 
tion. Therefore, we submit, the system of appraisal should be set up before 
the system of assessment. 1 he implementation of this idea is the concluding 
topic of the next and last chapter. 
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sulls of the first validation study of assessees operating in the ETO The 
percentage of unsatisfactory cases was found to be o' (zero) in four of the 
six brandies, whereas in one of the two remaining branches this figure was 
6 per cent, and in the other 14 per cent. Thus the chances of a man’s being 
considered satisfactory in some assignments were better than they were in 
others. If, in an attempt to minimize these variations, comparisons had 
been itstrictcd to assessed and unassessed men fulfilling similar functions, 
the number of men falling into each job category would have been too 
small to permit the calculation of differences that were statistically reliable. 

Thus there is no tangible proof that the OSS assessment staffs produced 
effects which more than balanced the expenditure of time and money. 

The number of assessed men and women who developed neuropsychiatric 
symptoms in the theater seems low in view of the unusual pressures, respon- 
sibilities, and dangers which stood in the line of duty for so many of them. 
It is necessary to remember, in this connection, that the OSS personnel in- 
cluded a large number of young women working under stress, many of 
them in tropical countries, many in London during the Little Blitz and 
throughout the subsequent six months' battering by V-i and V-2 rockets, 
as well as scores of refugees and Hollywood writers and performers deprived 
of the way of living to which they were accustomed, and numerous spe- 
cialists, many of them intellectuals whose previous style of life was poor 
preparation for urgent enterprises in military installations overseas. Further- 
more, one must take account of the fact that the OSS had been called upon 
under wartime necessity to undertake projects for which there were no 
precedents in American history, and, consequently, there had to be a great 
deal of spur-of-thc-moment improvisation, hasty trial and error, and sudden 
changing of plans which resulted in boundless confusion. It was a matter of 
quickly learning by quickly doing, novices leading novices. Hence the OSS 
was not an organization into which an insecure, dependent, unresourceful, or 
rigidly methodical individual could easily fit. Taking all these points into 
consideration, the incidence of neuropsychiatric illness seems gratifyingly 
low. The incomplete records of the Medical Branch of OSS show that only 
a small minority of the reported breakdowns were screened men. Thus 
there is some basis for supjjosing that the assessment staff, by identifying 
and rejecting the recruits who manifested neurotic or psychotic tendencies 
at the time of examination, made a substantial contribution to the efficiency 
of the organization. 

Before attempting to arrive at a final verdict we should consider (i) the 
question of the inevitable and irreducible percentage of failures; (2) the 
question of the percentage of failures due to deficiencies in special skills, 
the determination of which was left to the branch administrative officers 
and their chiefs; (3) the question of the percentage of failures due to the 
conditions under which assessment was conducted; and (4) the question 



452 


Assessment of Men 


«miriXmage‘7^^ proper 

the oaurrcnce of improbable circumst m • hccausfof 

he thinks of them as lying wiiliin the rcalin'of 'L' ‘ even if 

erly, leave out of his figiirinus nreciselv l' 1 ’'Sthihty, will, ^]uuc proc. 
the information that we now have for^ they arc incalculable. With 

foretell that a I>°S 

f«yehological strains (pain danu r ul f'!'’ S 

tty. criticism, depredation, confusion \lisl-, refoi'^ 
routtne, physical discomfort, and so orS vh H 
; e effidency of many of the’sc mertl^t they wl dT! "I 
n was, of course, not possible to forcteh which /T' 

(one out of every twenty) would in the twv, , ‘ examined 

assaulted to this extent. The candidates Ind m'hr ‘"‘"'"’/l" P'^^'^'^oJogially 
usual range of stresses-the stresses to w ; i 
would probably be exposed-.l)ecausc if thev 1 ,‘‘m 

,l» <»IW «p«/,0 m.c,^ ’ J ‘"7‘ Fr ca.. „( ,|,,,„ „„„,3 

happened, performed their duties satisf candidates, who, as it 

, K >h= o,8ani,r„i.„ whirlrilr ^'1 

the mmiraum prmuage of break, t„„|, ! , ' « iiisiileni u(»n 

of «.pt,nre be ,ai»d c„..,,a3;, 1“ T“’ I’"' 

Kondad call, f„ , J- .‘'j, 'ho M, lag b^ 

"ome m.ii.udoii, may be desirahfc' I „ 1 which far 

"'gom plan, and h/rccr„i b 1 nT"'''"' “h, wirh ii, 

I' mn,, , hereto, c, be acknawlaV J d !' impraclkal, 

inevitable when operating with a^stand ‘ / n"" 

principally because no human being can nred '**" 'r iJnceasonably high, 

0 men will be called upon at som! fm,/ asscrnblfg 

Wo amennr at ,.rai„. tCis Z^“rrf c"''; » ’“h Imprab? 
joining our organization, had had more iIi/T’’ who, before 

anci, as a member of OSS, played a crc li I !' 

telligence operations during iL swa- , I' n in- 

dressed as a French peasant. w.as Tral . I Gny, 

not long afterward was picked uo as t fJtrman lines, but 

nearest Gestapo headquarLs, and subiecte^r^T’ I"’ 

?-o, irart a:: ~ f ■ 

■ ™ -p- --ithZrdZfb-z^z; 



Conclusions and Recommendations 453 

for further enterprises. The assessment staff, which included neither major 
nor minor prophets, had passed him as High Average, which was probably 
fairly accurate; but, as it happened, he was one of the relatively few men 
who had to face an unusual ordeal and so ended a not undistinguished 
career as a nciiropsychiatric casualty. ° 

In addition to the possibility of an unusual amount of strain, there is the 
possibility of the improbable occurrence of a specific strain, a kind of strain 
which is tolerable to most men but intolerable to a few. All asscssecs who 
were recommended for overseas duty had a fairly high level of general strain 
tolerance, but a good many of them were susceptible to one or two specific 
kinds of strains. Some, we discovered, could not work very well in sub- 
ordinate position.s; others could function competently only as members of 
an efficient, harmonious unit— snafu was unbearable to them; some were 
highly trained specialists who hated to devote much time to matters that 
were unrelated to their fields of interest; others were civilians who resented 
deeply some of the. special privileges enjoyed by officers and were easily 
offended by any .show of military authority; still others would become 
apathetic and irresponsible when there was nothing definite for them to 
do; and .so it went. The assessors knew that these and many other kinds 
of prc,ssurc.s were prevalent in the theater,s, but they could not guess which 
candidate.s would he confronted hy which pressures. The specialist, for ex- 
ample, who wa.s invulnerable to a variety of disturbing conditions and 
expressed intense interest in his proposed assignment could not reasonably 
be rejected on the general ground that there was one chance in ten that he 
would he given another and to-him-unbcarable job as soon as he arrived in 
the theater. The restless extravert who was fit for everything except 
delay and inactivity could not be screened out merely because there was 
one chance in twenty that he would be forced to wait for a month or 
two when he reached Calcutta, and it was thought that if he did have that 
much time on his hands he would take to drink and women. A man’s 
level of performance was likely to depend, in some measure, on the char- 
acter of his commanding officer and the character of his teammates, but 
there was no way of discovering ahead of time who these associates would 
he. A very hearty assc.sscc, Stub, who was considered a rare “find" because 
he was intim.ntely aetjuainted with many influential residents of a stra- 
tegic occupied zone of coastal China, could not be rejected by assessment 
on the basis that he was a man of strong personal prejudices with whom 
some people would find it difficult to work harmoniously. He got on well 
with mo.st of his associates at Station S and was eager for his proposed 
assignment, but, as luck would have it, when he arrived in China he was 
paired with an utterly incompatible person. Their tactical conceptions proved 
to he irreconcilable and they quarreled so violently that it became apparent 
that it would be impossible for these two to cooperate effectively in carry- 
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standard -of exceUence maintained by the organization; (3) the number of 
new men needed per month; (4) the number of recruits obtainable; and 
(5) the stntabthty of these recruits. As a rough guess, we might say that 
about 2 or 3 per cent failures were the irreducible base-line figure fi the 
assessment: or OSS personucl. 


In this discussion of inevitable prediction errors the problem has been 
much simp ified tor purposes of exposition. Actually the business is much 
more complicated. Lor instance, in deciding the fate of a candidate, assessors 
do not, in fact, disicgard all improbabilities, because many candidates are 
susceptible to a number of different kinds of strains, and, although the 
probability that this or that particular strain will occur is small, the prob- 
ability that at least one of the lot will occur may be appreciable. Further- 
more, there is a certain probability that two or three strains will occur to- 
gether or in succession, and chat the assessee may be equal to coping with no 
more than one. 


It should be pointed out that although an assessment staff will not be 
able to reduce the base-line figure of unsatisfactory cases (a figure which is 
determined by the conditions imposed by the organization), it might be 
able to reduce the pciccntagc of prediction errors on its own records by list- 
ing in each case the improbable strains which would, if they occurred to a 
marked degree, seriously affect the man’s efficiency. 

The second majtJr question is that of the number of men who failed be- 
cause of some deficiency in specific skill. As explained in Chapter I, it 
was not possible to recruit an assessment staff, to standardize objective tests, 
and to acquire or build the equipment necessary for measuring dozens of 
different aptitudes, such as that for training homing pigeons, for setting 
Japanese type, for drawing posters that would influence the German people, 
for piloting an airplane, for running a Diesel engine, for taking moving pic- 
tures, for speaking Burmese or one of fifty other languages, and so forth. 
The assessment staff attempted to estimate about ten general abilities, such 
as physical ability, instructing ability, and recruiting ability, but it was 
not in a position to measure skills which were as specific as those listed 
above. Consequently, It was agreed that each branch administrative officer, 
aided by his asstjciutcs, would take the responsibility of deciding whether 
the candidates recruited for his branch possessed the necessary technical 
qualifications. The administrative officer’s decision was based on the candi- 
date’s work history, on information furnished by the man’s acquaintances, 
on data supplied by the Security Branch and by the Personnel Procurement 
Branch, on the results of interviews, on the candidate’s record at the OSS 
schools which he attended, and on his work in the Washington office before 
he was sent overseas. 

Unfortunately, in obtaining appraisals of unsatisfactory assessees in the 
theater, we did not attempt the difficult task of determining to what extent 
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a lack of specific skill was, h\ each ease, responsible fur failure. Our records 
show an intricate combination of factors in most instances. A member of 
an organization who cannot do what is expected uf him is immediately 
confronted by the stress of self-criticism and of eriticisiHj ini(dicit or ex- 
plicit, from his supervisor and from his cl^-\vf^rkcl^s, His scdficonfidence will 
diminish, and feelings of inferiority will emerge; he is likely to become 
hypersensitive and defensive in his social relations, and blame others for 
his own shortcomings. Emotional stability and motivation will decrease and 
he may end by spending a large portion of his mental energy inventing 
excuses to justify his inadequacy. Thus, as s(K)n as the strength of one 
component— in this case that of specific ability^ -dro[)s liclow a certain 
minimum, other components arc similarly affected, and, on examination, it 
is very difficult to ascertain which factor was primarily responsible for the 
now-pervasive deterioration. Contrariwise, a man whose talents are exactly 
suited to the job assigned to him and who, therefore, attains or surpasses 
the level of social expectation for hin>v will be cotuinually encouraged by 
signs of approval and of respect from hi.s associates, and under these con- 
ditions, his energy and initiative, motivation, effective intelligence, emo- 
tional stability, and social relations arc likely u> reach their maximum. If 
these facts had been fully appreciated at the start, and if sufficient time 
had been available, we would have set oursedves the task of making a much 
more thorough analytical study of the causes of failure. 

In the great majority of unsatisfactory casc>s, incompetence was given as 
the chief cause of failure, but it was hard to decide (i) whether the in- 
competence was due primarily or solely to a lack of innate or acquired 
talent; or (2), if it was due to a lack of talent, whether it was one of the 
talents which the assessment staff had undertaken to measure. Sometimes 
an appraiser would say: “My secretary is a nice girl, extremely obliging 
and good-natured, but she is a very incompetent typist, She is slow, in- 
accurate, and extremely weak on s[>elling. She is more trouble than she is 
worth.*’ Here the decision was simple, because the measurement of sten- 
ographic ability did not fall within the sphere of assessment. In many 
cases, however, the matter was debatable. Take the Cjcrman-Amcrican, 
for example, who was sent to London to write prcjpaganda script. Assess- 
ment found that he had been very successful as a writer of motion-picture 
scripts and that his verbal facility was unusual. His administrative officer 
made certain that he was able to read niul write the German language. 
But in London this asscssce’s branch chief concluded that he was unsatis- 
factory on two counts: his scripts were not of the sort that would touch 
the German people, and he could not write creatively in German, his 
mastery of the language being limited to the amount required for con- 
ventional communications. Here the responsibility for the prediction error 
seemed to lie partly with assessment and partly with the administrative 
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officer. There were many equally equivocal cases, and today we can do no 
better than to survey data we have at hand and make the conservative 
guess that about i or 2 per cent of the assessees failed primarily because 
of deficiency in specific skills, Adding this figure to the 2 or 3 failures per 
hundred clue to the occurrence of improbable events, we get a hypothetical 
rough total of 3 to 5 per cent failures due to factors outside the sphere of the 
OSS assessment program. 

T*lie third rnajor cjucstion is that of the number of inaccurate assessments 
which were dne to the embarrassing conditions under which the screening 
process had to proceed. Since these conditions have already been sufficiently 
discussed in previous chapters, they need to be reviewed only briefly. As 
wc have said, the most disconcerting condition was the staffs ignorance 
of the exact nature of each proposed assignment— the nature of the role 
anfl the nature of the environment in which the role would have to be 
fulfilled. In respect to its assignments, the OSS was, indeed, a very 
peculiar organization, because it was planning to do things which no Amer- 
ican had ever done and, therefore, there was no available firsthand knowl- 
edge of the tasks to be accomplished. Certainly the psychologists and 
psychiatrists on the assessment staff knew no more about the character of 
these extraordinary employments than they did about the kinds of situa- 
tions which would confront OSS men in different distant areas of the 
glcihc. It was not known in the winter of 1944, for example, that one branch 
in one overseas theater was so frustrated in its plans by other overlapping 
and com{}eting agencies, and consequently so disorganized, that only a man 
with a rather high degree of snafu tolerance could work there effectually. 
This was the branch in which the figure for unsatisfactory assessees was 
14 per cent. After a survey of all our cases of failure, our rough guess is 
that about two out of every hundred assessees were recommended for jobs 
in which they performed unsatisfactorily, who would have not been so 
approved if adequate job analyses and accurate accounts of existing con- 
ditions in the various theaters had been available, and also— to include a 
factor which belongs in this category— if each assessee had been given the 
job, or one of the jobs, for which he had been recommended by assessment. 
The OSS was also rather unique among institutions in respect to the 
great variety of assignments for which candidates were slated, and the 
urgency which characterized all its manifold undertakings. As a result, 
it was necessary to test at one time (during a single onc-day or three-day 
period of assessment) a group of recruits who had been selected for man) 
different kinds of assignments. If it had been possible to assess, first, a 
body of men all of whom had been picked for projects which involved 
hazardous physical activity, and then, a number of administrators and 
executors, and, after that, a group of office workers and stenographers, a 
concentrated and unified assessment program suitable for each type of job 
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could have been devised, lu which case tl\c asscs'^ors, in observing each suc- 
cessive group, would have found it less difllcult to keep in mind the special 
qualifications required of every randid-ile before thcni. Witli a differentiated 
system of this sort, it might have been [lossiblc to reduce the frequency of 
failures, say, by approximately i per cent, 'rims, aecordiivg to our hypo- 
thetical calculations, which, of course, .should not he taken too .seriously, 
a total of 3 per cent failures might he aitrilmt.ihle to the embarrassing con- 
ditions under which OSS assessment was forcctl to operate. 

The percentage of errors which remain is ascrihahle. to defects in the 
as,scssment process per sc — limitations of the techniques employed and errors 
of clinical judgment. Since .several chapters have already been devoted to 
descriptions of our procedures, further comments on this score could only 
serve to oversatiate the reader. Rut here, before leaving this topic, it might 
be helpful to call attention to certain import.mt attributes of personality 
which cannot be well measured by any known assessment procedures. Some 
of these arc as follows: 

Endurance.—Physical endurance is .so much a matter of svhether a man 
happens to be in or out of training that a series of exhausting exercises is 
useful only if all candidates have experienced .a month or two of equally 
hard physical conditioning. To attempt to test intellrctutil endurance nr, 
what is more important, emotional stamina in a one day or thrcc-day 
assessment program is scarcely feasible, ami .so asscsso.'s, knttwing that 
endurance is a very important determinant tif success, must attempt to 
estimate it indirectly. 

Long-Term Social Relation.s.—In a thrcc-day program of a,ssessmcnt, 
a responsive, enthusiastic, genial, quick-wittctl, and perhaps humorous fel- 
low is apt to make a favorable impression. Ills exuberance is inviting 
and contagious; he is facile in conversation and in debate; he is not 
embarrassed by having to play a part in the psychodrama; he contributes 
to the liveliness of every occasion, and, in the end, both candidates and 
stall are likely to give him a high mark on Social Relations. (The 
assessors at Station S were no doubt uncon, sciously dis[K),scd to overrate 
men who enjoyed and entered into the .spirit of a [irogratn which they 
had designed and were aclmlni.stering.) vSome cantlidaics of thi.s type, 
however, have a number of annoying traits which they are able to hold 
in check for a short time, when their need to |)lcasc is uppermost, but 
which emerge later when vigilance is relaxed. Also there arc some ideas, 
attitudes, and manncri.sms which on fir.st appearance arc entertaining but, 
on repetition, become exceedingly tedious and irritating. Tltat it is diffi- 
cult to pick out all the candidates who will not “wear well” on long 
acquaintance is evidenced by the fact that the OSS assessment staff 
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rccomniencled several men with exhibitionistic tendencies which appeared, 
when modulated at Stiulon S or W, to be generally acceptable, if not 
appealing, htil provctl, when vented overseas, to be insufferable, 

Contrariwise, there is a tendency to underrate the shy, reserved, and 
taciturn introvert, bccau.se a person of this type is apt to take more than 
three days to warm up lutd display his full capacity for social relations and 
leadership. In a short time it is not possible to test the strength of such 
substantial qualities as integrity, loyalty, patience, and forebearancc. 

Imagination.— The inlelligcnt management of situations in the future 
depends to a considerable extent on imagination— the ability to anticipate 
numerous possible contingencies and to conceive of a host of alternative 
forms of elfeclivc action. But imagination of this sort, the. distinguishing 
mark of a truly superior man, takes a long time to work itself out, and 
therefore cannot be measured in a three-day session. It depends on the 
persistence of concentrated thought as well as on the excitement of un- 
conscious processes which intermittently, and often at the most unexpected 
moments, enter consciousness to provide the needed idea. For this, a 
period of incubation is reciuired, longer than is usually available to assess- 

"^Thesc, then, are .some of the as yet unsurmounlcd limitations of assess- 

"'tlavinK come to tlie cnrl of this discussion, it might be helpful to sum- 
mari'/.e (lur conclusions by listing the chief reasons, as we see them, tor the 

reported failures. 

CHIEF CAUSES OF PREDICTION ERRORS 


o” Occurrence of improbable strains: inevitable and irreducible base-line factors. 

which take months to manifest themselves. 

Unavoidable under 05S condiHont, the inhere 

3 ) Deficiencies of some candidates in specific skdis falling P 

s) .. cnnnldcrnJ in .»»inS “mW, of cool 

group of candidates. 

Avoidable: , 

6 ) Errors of judgment, defective techniques. 

7 ) Imperfect modes of appraisal. 

We do not know whether our level of attainment was 
than that initially expected of us by the administrators of the OSS, 
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chelcssj it is iiuercsting in ihis connection Lr» take a look at the level t)f attain- 
ment accepted by everyone as the highcM legiurnatc ann of the members of 
the Medical Branch. 

The Medical Branch was nut asked to predict, in each ease, whether 
within the next two years the candidate would be iticapacitatcd by malig- 
nant jaundice, thyroid disease, or a fractiuc of the leg; anti when ill- 
nesses and accidents did occur in the field, these were not listetl as failures 
to diagnose lack of immunity to such phy.sical conditions. The study of 
susceptibility to certain diseases as a function of tlie physical constitution 
is in its infancy, and it is still an accepted fact that a physician cannot 
predict from which illnesses, if any, a man will suffer in the future. 
Knowing the frequencies of different causes of death in a given popula- 
tion, he can foretell with a fair degree of accuracy what proportion of a 
given sample of human beings will die of heart disease, of kidney disease, of 
cancer, and so forth; and knowing the incidence of malaria among Amer- 
ican troops in Burma, he can guess what percentage of the men who are 
sent to operate there will contract this disease if conditions remain un- 
changed; but he cannot pick out the individuuU, among those examined, 
who will finally die of this or that illness, or wins if th<^y should go to 
Burma, will succumb to malaria. Thus he has no basis for selecting some 
healthy men and rejecting others. His highest aim is to discover all the 
existing symptoms of disease. On his list of failures will be included the 
names of all those who had symptoms which he failed to note at the time 
of examination, but not the names of those wl\o developed symptoms later. 

The characteristics of personality (inintl-braia structure), of course, dillcr 
from those of constitution (somatic structure), and, despite the fact that 
the former arc more complex, more flexible, and more fitful than the 
latter, it is probably possible to make a greater number of correct long-range 
prognoses about personality than can be made about constitution. Most 
physical diseases, for example, develop suddenly without warning, w'hereas 
the onset of a neurosis or of a psychosis is very likely to be preceded by 
months or years of premonitory signs. But, today, it is not known in what 
particulars or with what amount of accuracy psychologists and psycluacri.sts 
are capable of predicting future behavior or levels of accfimplishment. Per- 
formances dependent on certain functif)ns (c.g., intellectual) exercised under 
certain conditions (c.g,, school and college situations) and measured by cer- 
tain ratings (e.g., grades on examinations) can be foretold with a reasonable 
degree of certainty by certain tests (e.g., scholastic aptitude); but when 
these functions are exercised under other conditions or measured by other 
indices, or when it is a question of the effectivcnCsSS of one of a large number 
of other dispositions or abilities (e.g., leadership in different fields and at 
different levels), the degree of validity that a trained psychologist can reason- 
ably be expected to reach with his predictions is not known. And since 
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ignorance is general on this point, the prevalent tendency among enthusi- 
astic clinical [)sychologists and among laymen who are favorably disposed to 
psycholfjgy is to place the level of expectation too high, to ignore the fact 
that a certain irreducible (sometimes high) percentage of predictions will 
inevitably he incorrect. In view of this tendency toward optimism so char- 
acteristic of those who venture into unexplored territory, it might be argued 
that assessment psychologists should not, for some time, encourage t^m- 
sclves or others to anticipate that they can do more than identify existing 
deficiencies and (iroficicncics. Eventually it will be discovered in what re- 
spects and to what dcgree.s and under what conditions they are capable 
of predicting future Iwhnvioral developments. 

So far in this chajiler, di.scussinn has been restricted to the population of 
failure, s, the recommended assessees who were rated Unsatisfactory in the 
theater nr in Washington by returnees from the theater. Although these 
failures constituic the most serious errors of prediction, they add up to only 
a small fraction of tlie total. One unanswerable question is this; How many 
rejected candidates would have proved satisfactory had they been sent over- 
seas? Since all recruit.s were assessed in relation to our conception of the 
usual degree of .stress in this or that theater, and since the stresses actually 
encountered by a certain proportion of the men were much lighter than those 
encountercf! liy the majority, it is certain that some of the rejected men 
would have been equal to their confronting situations. But here again, it 
was im[K)Ssiblc to foretell who, among a given group of candidates, would 
be exposed to heavy slrain.s, and who would be exposed to light. 

The majority of the errors, however, consisted of apparent overestimations 
or underestimaiions of recommended men who performed satisfactorily 
overseas. Thc.se errors were reviewed in Chapter IX. To explain them we 
would recite the chief cau.scs of screening errors as listed above. We would 
be very dubious, of course, as to the proper relative weight which should 
be attributed to each of the different factors. 

The statistical evaluation of the ratings made by the OSS assessment staffs 
is not the .sole, or perhaps even the best, index of the value of the program. 
As important as the. ta,sks of .screening out unsuitable recruits was that of 
writing a per.sonality sketch of each candidate which would aid his branch 
chief and administr.ativc officer in understanding him and in a,ssigning to 
liim duties in line with his talents. Whether this task was well performed 
hy assessment is a ()ucstion for the. branch administrators to decide; but 
it can be rcjxirtcd that whereas in the beginning there was a good deal of 
outspoken distrust and skepticism, and some opposition, on the part of 
many of the OSS ndministratnr.s and executives, in the end a large majority 
of them gave very favorable estimates of the utility of the program, despite 
the fact chat assessment, hy rejecting some 25 per cent of their recruits and 
so annulling an incalculable amount of effort, was acting as a frustrating 
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interference to the smooth and rapid Haw of personnel and, as such, ccnisti^ 
tuted an ideal target for pent-up aggression. 

THE PROMISE OF ASSESSMENT 

The writers of this bewk have much evidence to support, and no evidence 
to contradict, the assumption that the psychologists and psychiatrists of the 
assessment staff arc virtually unaninious in their tipiniou that the OSS 
system of examination, and diagnosis was better than any with which they 
had previously been familiar. Certain parts of tlic prtigram, to be sure, were 
not considered valuable by all of iis> but, taken as a whole, the series of 
procedures gave the members of the staff a surer vsense of "knowing a 
man," more confidence in 'their formulations and recommendations than 
they had ever enjoyed before under similar circumstances, that is, when 
called upon to size up large numbers of men and women in a relatively 
short time. 

Although the all too human tendency, common to members of a congenial 
group, to overvalue their own productions must certainly be included 
among the determinants of the staff mcmlicrs* favorable verdict, and 
although their conviction that asscssccs \vould behave in the field as they 
did at assessment was probably greater than was justified, nevertheless it 
seems that, In the absence of conclusive .scientific [)rtJof of the special merits 
and defects of the system, the consetisus of an experienced and cvcr-critical 
staff is a reasonably good index of the vvortli of the procedures. 

In this section, however, we arc not concerned with the question of the 
efficacy of our system of assessment under the conditions imposed by the 
OSS, but rather with the question of its probable utility in the future; and 
here the members of the staff arc agreed that it could he developed into an 
extraordinary instrument for accomplishing three important purposes simul- 
taneously; (i) the selection of the most suitable persons for important jobs; 
(2) the advancement of our understanding of personality; and (3) the 
adequate training of clinical psychologists and psychiatrists, 

Some men are inclined to the opinion that only tho.se sciences which can 
offer unequivocal quantitative proofs of their accomplishments are worthy 
of financial or institutional backing. Foriimatcly for psychology, however, 
there arc a few who judge otherwise, who take the absence of tangible 
evidences of accomplishment as an indication that the science in question 
is a young one and, therefore, in need of special support for its develop- 
ment. 

The fact that the initial researches, the explorations, and pilot studies of 
workers in a young science have not led to any definite or startling results 
is no argument against the encouragement of that science. As Pasteur 
answered to a questioner who was skeptical of the value of the infant science 
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of bacteriology, “Wliat good is a baby?‘* Every science must pass through 
the stages of infancy, childhood, puberty, and adolescence before it reaches 
the point of maturity at which even the near-blind can see its worth. 
Since this is inevitably the case, the more encouragement that is given 
to an immature science the sooner will it arrive at the desired stage of con- 
ceptual and practical effectiveness. Let us take an extreme case and assume, 
for the sake of argument, that it is true, as some have claimed, that not 
until after i^oo did medicine pass from the stage of doing man more harm 
dian good to that of doing him more good than harm; and then ask 
ourselves, what would have been the most enlightened attitude to hold 
toward medicine a hundred years ago? To abolish it or refuse to support 
it because it was doing more harm than good? Or to encourage it so that 
some day it would do more good than harm? Let a man with severe 
diabetes, pernicious anemia, syphilis, or acute appendicitis answer this ques- 
tion. The point is that the scientific method of observation, tentative inter- 
pretation, hypothesis making, and verification is almost certain to succeed 
in the long run whether the objects of concern be animal, vegetable, or 
inineraL Some sciences have already attained a large measure of success, 
have proved their usefulness and can pay their way; but there are others 
which have not yet reached the stage of self-sufficiency and so must turn 
to public-spirited individuals, to government, to cultural institutions, or to 
foundations for assistance. 

Faced by a diversity of plans for scientific research, decision as to institu- 
tional or financial support should, in each case, hang largely on the best 
obtainable answers to four questions: (r) How' important to man’s welfare 
would be the ordered knowledge that is the special goal of the given science? 
(2) What are the chances that the specific objectives of the proposed re- 
search will prove to be strategic in the advance of this science? (3) Are 
the methods selected for attaining these objectives likely to be successful? 
(4) Is the available staff of scientists equal to the undertaking? 

To us it is self-evident that the science of man stands above all other 
sciences in the rank order of importance, especially today, at this critical 
point in the evolution of our species. Never so urgent has been the need 
for knowledge of the determinants, components, and consequences of social 
forces and interactions, the need for adequate means of surveying, measur- 
ing, interpreting, predicting, and controlling the behavior of men. Today’s 
special urgency is the result of the present perilous gap between man’s power 
to create and to manipulate physical forces ejffectwely and his power to 
create and to manipulate them wisely^ a gap which is correlated with 
the wide discrepancy which now exists between the state of perfection of 
the physical sciences and the state of imperfection of the social sciences. 
One of the chief aims of our time must be to diminish this discrepancy, 
because material science has taken on the character of a cancerous growth, 
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and, if not balanced by ilu: dtvTlMpjn! iit ni ,i u^atijr mki.iI '.virnce opcrai' 
in the scirice of hununmiic vJucs, i( u<ll mk.-;;- ['a-a, frotn the stated 
doing man more good than liaiin tti that ui d-attg iintt itinjc ii.iim than 
good, if not of tlenitthshing his mnst v.ihscd tiiststuticmr,. 

It is within the broad franicwoik (tt a gteat jiiati to advance tlie basic 
social sciences all aking the line that the (‘icscnt schetne for a research 
assessment agency, or institute, should he envisaged, 

I he essential characteri, sties of the .system of a.sscssmcm we. are advoc it. 
ing are as follows: 

i) iocial setting: The whole iirogr.im is e.<m,liictc<i witiiin a stKial matrix 
composed of sttifl and candidate.s, which [icrmits frequent informal con- 
tacts and, tliereforc, many opjwrtunilies to observe typical rno.lc.s of rcsthjn.se 
to other human beings, ' 

a) Miilttjorm procedures: Many dillcrciu kitnls tif techniques arc em- 
ployed, running all the ss-ay from .stamiardizr,! tests to uneontrt.llcd situa- 
tjons, special attention being given to tlic interviesv, to projective techniques, 
and to performance tests. ‘ 

3) Ufeht^e tas{s: Asscssccs arc given lifelike ta.sks in a lifelike environ- 

^ complicated, requiring for their solution organization 

of thought at a high integrative level, and .some of them nuist be performed 
under streiis in collaboration with oiliers. 

4) Fornnilatmis of personality: guiricient data arc collcctctl and sudicient 
time is available to permu conceptualization of the form of .some of the chief 
components o t ic personality of each a.sscsscc, ihi.s forinuhuion licing used 
as a iranie of reference in making rceommciulation,s and predictions 

5) Staff conference: Interpretations of the behavior of each a.s,ses.scc arc dis- 

cussed at a final meeting of stall meinhcr.s'. and decisions (ratings and 
lecommendattons) arc reached by coiuscnsiis. ^ 

of formulations of personality, the rating.s 

in fl fo e0ectivcncs.s arc systematically recorded 

with later appraisals treatment and prcci.se comparisons 

tion^ Special attention is devoted to the pcrfec- 

the reliable rnea.surcs can be obtainetl of 

each variabk^ ‘ as,sessmcnt program and of the ratings of 

of'^he snlTicienc as a rcmiiulcr of the chief features 

of an ifT ° °°8y^ e,scribed in tliis volume. The three major objcctive,s 
be as fdbwr°^ ^tistitute committed to the.se principles in peacetime would 

Most Suitable Men for Imixntant Position.?.— Since 
system o assessment is more expensive and time-consuming than 
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other systems, it cannot be recommended when the task is that of pick- 
ing several thousand men a year for jobs of minor significance, particularly 
if the qualifications for these jobs are chiefly technical. But our system of 
assessment is preferable, we believe, whenever (i) an institution or a com- 
bination of institutions must pass on the suitability of about four hundred 
to one thousand candidates a year; (2) the quality of the selectees is a 
matter of considerable importance; and (3) the requirements include the 
ability to work effectively with others, either as leader or as cooperator. 

Although one thousand candidates a year are about the upper limit for an 
assessment staff of twelve men administering a thrce-and-a-half-day program, 
there is no limit to the number of candidates who can be properly examined 
if the institution to be served is willing to increase the number of assess- 
ment units. Also, although a one-day assessment is not advisable at this stage 
in the development of the methodology, it should be noted that one staff, 
administering a streamlined program of this length, can handle over two 


thousand candidates a year. . , , , . / s •( 

The quality of the selectees is a matter of considerable importance fi; it 
a good deal of time, talent, and money must be spent in training them (c.g., 
selectees for Annapolis or West Point), and/or (2) if they will eventually 
be in a position either to benefit greatly or to injure gready the cause of 
the people or of the institution they are serving (e.g., business executives, 
government officials, educators), and/or (3) if it will be difficult m discover 
their deficiencies and replace them promptly once they are appointed fe.g'. 
foreign representatives of a government or of a^ business concern). 

Since the system of assessment described in this book includes, or can be 
adjusted to include, not only all the pertinent standardized tests which are 
used today by personnel pyschologists but, in addition, numerous other 
more inebsive procedures not heretofore employed, and since this system 
r embraces, as an integral part of the whole program, a pmeedure or 
evaluation which will reveal the specific errors made and thus lead in- 
evitably to a continuous series of technical improvements, it is bound to 
be oml. provided its development is in the hands of properly trained p y- 
clXists and psychiatrists, the most effective system of assessment There- 
fLe. ft can he recommended, first of all, on the basis of the practical service 


irffifaulSmi' urconsequences <if the openthn d an assessment 

ministrators of the organization will be benefited y g 
of psychological knowledge pertinent to the P j ^ ^ 

Although we believe that assessment will more than pay for 
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practical enterprise, in the present stage nf its drvrlopnuMit a fairly large 
fraction of the stall’s energies should be devoted iu rcseaixli» and, tlicrefore, 
an agency o£ this sort will probably require some financial sttpptjrt from 
a nonprofit source. 

The OSS system of assessment was designed as a tneaiis of selecting 
and placing special personnel, but it can readily he adjusted to serve other 
purposes, such as that of diagnexsis in connection with the rehabilitation of 
delinquents or the reconditioning of ncuropsycliiatfic casualties, Many of the 
procedures, for example, could be used eilcctivciy in conjunction with group 
therapy. 

Development of the Science of Man — Tlie main Iwidy of [psychology 
started its career by putting the wrong foot ft)rwMrd and it has been out of 
step with the march of science much of the lime since. Instead of begin- 
ning with studies of the whole person adjusting to u natural smial environ- 
ment, it began with studies of a segment of a person rcs[>onding to a 
physical stimulus in an unnatural laboratory environment, Cajuscqucntly, 
after a century of diligent application, psychologists still lack suflicient 
ordered knowledge of everyday social behavior, 'fheir attcm[)ts to over- 
come this handicap by adding or associating in some way the psychological 
processes which have been scientifically investigated in the laboratory 
have not been notably successful, 

One reason for the early false step and subsequent distorted growth of 
psychology is the fact that human beings arc not sci comjdiani as chemicals, 
plants, and animals in submitting to scientific scrutiny and manipulation, 
especially if the cool eye of the psychologist is ftjcuscd U[ion their central 
determining inclinations, their feelings, and their mr^tives. Oinscqucntly, the 
easiest course for the first experimental psychologists to folknv was to limit 
the field of inquiry to studies of the unrevealing peri[)heral processes of 
perception which are IcaiJt related to the subject’s self-csiccm and by so 
doing give the latter no cause for indignation, noncompliance, nr deception, 

The first to occupy themxSclve>s with systematic observations of the deter- 
mining components of personality were the medical [psychologists and later 
the psychoanalysts, who were forced to it hy the necessity of understanding 
and so relieving the afflictions of tlicir patients. It was [Kissible for these 
physicians to invade the .secret core of [personality, first, bccnu-sc their 
patients, craving some relief and [persuaded that frankness was the (price they 
had to pay for it, were willing, if not eager, to confess many of their 
inmost thoughts and feelings; and second, because the physicians dis- 
covered ways of painlessly seeing through, circumventing, or dissolving the 
forces protective of self-esteem. Thus great progress was made. The psycho- 
analysts, however, were necessarily more intent on discovering the deter- 
minants of morbid complexes than they were on discovering the 
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determinants of effective health, and, as a result, have today more facts 
and theories pertinent to abnormal than to normal psychology. Some mis- 
conceptions advanced by the psychoanalysts were the almost inevitable 
results of their practice of observing patients in one situation only— that 
of the consulting room— of their special preoccupation with fantasies rather 
than with actions, and of their having to construct a picture of the early 
social relations of a patient almost entirely from the latter’s own impres- 
sions, many of them shadowy. 

The cultural anthropologists and sociologists, however, have succeedea 
in correcting some of the twists of psychoanalytic thought by furnishing 
evidence of the determining influence of different cultural forms, ideological 
and behavioral Consequently, the modern psychologist, armed with the 
critical standards and the technical methods— statistics, rules of test construc- 
tion, and so forth— acquired at the university, and then trained in t e 
theories and methods of sociology and psychoanalysis, is in a position, for the 
first time, to advance the science of man directly, by the study of relatively 
normal men and women in a social context, as well as indirectly, by t e 

studVi sav, of animal behavior, . 

Although there are numerous psychologists who are now equip^d to 
„„l,>,khuch .krc is. ss alws,, she praefcl P'*'™ “' S” 1 

,1,0 sl,ua,i<ms in wl.icl, these can be earned on, sueeessMly. Under 
wL eondititms tvill normal adulls submit to scjentific 
an iranedinR deurce ot resistance and resentment? One answer to this qure 
Znl thatlhe American people have come to concede 
right to test applicants for membership in almost “V ''•? *2n‘oM 
as^ experience ha.s shown, most applicants undergo the assessmen p 
IZ esentmont. A few d.sitable men may perhaps be 
Tn aversion to being tested, but a greater number will be attracted by th. 

challenge to thei, abiUdes In A' JlfolZ iuon 
;::lZrds“L”r p'rZd of l member. 

the screen though not usually, to be sure, in the minds of those who mi to 
pass. ,t bis been » 

I’rS'ftZpCn- becomes a neg%^^^^ 

agency constitutes one of the most, if not fAe mos > P 

ing normal adult personalities. ^ assessment, or 

For researches into normal personality, ys«m , 

something comparable to it, romoonents of the total per- 

do not include investigations of t e understand the character 

tonality and aVIT res'uTof a^ tremendous amount of very 

rr,n1 W wfrk by hundred, of psyehologisrs devored to .... 
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construction and test adminisiration we have mday a large number of 
economical tccliniciucs, many of which apprar to !k reasonahly valid. Thus 
something definitely useful has come out f)f these expert lalrors. Hut it is 
not possible to say that they have added anytiiitig in our knowledge of the 
components and determinants of peiwmaliiy. 'To atlvaiicr our understandino 
of human nature other methods must he used. ° 

Ihcrc arc scores of strategic tpiesiions alwiiit the tlctermiiiants of effective 
behavior which might cvciitually he answered by an assessment institute 
that employed the system outlined in tliis Irook, I-or example, tlicre is the 
great problem of the conscuucnccs of various traumatic (H'currcncc,s in child- 
hood, Aceniding to the psychoaii.ilytic foriiiuU, neurotic symptoms arc 
resultants of rcprc,sscd dynamic complexes ctigcndcrcd by traumatic situa- 
tions in early life. Many different types of traumatic situations have been 
described, as well as the. dynamisms of ego tlefciisc and of comjdex-forma- 
tion, and also the tlifferent conditions in later life tinder which a complex 
is likely to erupt as a manifest symptom, Althtuigli certain links in the 
chain of causation arc still oliscuie, m.uiy now hrlirve that the chief deter- 
mining processes leading from the series of tr.uim.ita to the final psycho- 
logical disorder luivc been convincingly f.irmiil.ucil, One of the striking 
findings t)f the OSS assessment staff, liowevcr, vv.is the fretpiency of such 
traumata and such cnmplc,xcs in the past liisiorics of very effective person- 
alities. In not a few instances, indeed, the staff concluded that the complex 
was more influentially related to the proficirncirs than to the deficiencies of 
tie personality, ^ riicre is nothing very novel abtiut ilu,s oliscrvatinn: it con- 
forms to Adler’s notion of ambition ovcrcompens.uJng for an initial nar- 
cistic wound. But in many of our eases tlierc was no evidence of an exor- 
bitant craving for superiority: the underlying complex liad apparently been 
integrated into a personality .structure that was both balanced and com- 
petent. And so, to supplement our present knowledge of pathogenic tend- 
encies it seems that we require a mucli dearer understanding of the 
positive, creative, and health-building forces which ,so often succeed in 
cheeking, counteracting, or transforming the complexes of early life in 
.sue a w.iy as to protliicc characters which in certain respects arc stronger 
than they would otherwise have been. The question is, What determinants 
must be taken into account in predicting whether this or that hurtful occur- 
rence will impede or encourage the development of an effective pcr.sonality? 
We have learned a good deal about the. defen, sc mechanisms of the ego, 
ut a pcrsonaliLy cannot flourish by defense alone* Surely it is the forward- 
reaching and constructive forces which are chiefly responsible for integrated 
growth. And so, since these long-overlooked positive forces can be best 
mve,stigated in normal personalities, an 'a.ssessment in.stitute would be in a 
tavorable position to make a .significant contiihution to our knowledge 
ot human development, 
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But the opportunity to study normal people would not be critically 
important were it not coupled with the possibility o£ evaluating predictions 
of behavior agninst reliable observations in the future. The opportunity to 
study a group of individuals in one connection or another is not infre- 
quently afforded, but only too seldom is it possible to verify one’s conclu- 
sions by conducting follow-up studies of the subjects’ subsequent careers. 
Thus an assessment agency is in a peculiarly advantageous position: the 
candidates examined are destined, if accepted, to work in the institution 
for several months or years, and hence the staff will have the opportunity 
to evaluate hypotheses that are set down at the time of assessment. Since 
vve believe that the practice of making predictions and checking them is 
the method par excellence by which the science of man can be most sub- 
stantially advanced, we submit that an assessment Institute would be in a 
strategic position to contribute to this advance. 

Besides the opportunity (i) to appraise and to improve the techniques 
of assessment proper and (2) to investigate critical problems of personality 
development, an assessment unit, by including in its program a few sys- 
tematically varied situations, would have the opportunity (3) to subject 
selected hypotheses to tlic test of controlled experiment. Thus no mode of 
research would be excluded from its proceedings, 

The Training of Clinical Psychologists and Psychiatrists.— During the 
greater part of its short career clinical psychology has been the handmaiden 
of psychiatry, the psychologist’s role being comparable to that of the labora- 
tory technician in a hospital, limited to the administration of standardized 
tests with some research on the side if there was time for it. The relation- 
ship of psychiatrist to psychologist has been almost Invariably that of senior 
to junior, regardless of age. In some institutions the clinical psychologist 
has been entrusted with the management of personality problems in chil- 
dren, but seldom has he been requested or — when he was so forward as to 
propose himself— permitted to take full responsibility for the diagnosis 
and treatment of adults with psychological disorders. 

Up to very recently this definition of the psychologist’s duties was ap- 
propriate, since he had not been trained to function as an expert at the 
highest integrative level. For years faculties of psychology had been or- 
ganized to train students to carry on laboratory experiments, but not to 
educate them in the observation, interpretation, prediction, and control of 
human behavior under natural conditions. The professors had never con- 
sidered it their function to collect and transmit an ordered body of knowl- 
edge derived from reliable records of personalities developing in social en- 
vironments, never considered it their function to teach students the best 
modes of analyzing and reconstructing total human situations and of inter- 
vening when necessary. The content of textbooks and lectures dealing with 
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associations, and so forth. And even if these opportunities to learn by doing 
had been available, the student would have had no one to guide him, to 
check his interpretations and his interventions, because the members of’his 
faculty were scarcely more experienced than he was in carrying out such 
operations. In brief, the holder of a Ph.D. degree in psychology possessed 
few of the conceptions and trained skills needed for the understanding 
and counseling of relatively normal people, much less for the diagnosis and 
treatment of neurotics. Hence his career as a practitioner was restricted at 
the very start. 

During this era the situation in psychology was very different from that 
which has prevailed in medicine. The hierarchy of a medical faculty has 
always bccn» with some exceptions, roughly representative of the order of 
ability to observe, interpret, predict, and control the course of physical 
cliscuises. Today, for example, whenever a hospital interne is doubtful as to 
the diagnosis or the proper thcr»^py in a given case, he can always consult the 
resident physician, aiul after him the visiting physician, and after him 
the chief r)f tlie medical services, not to speak of numerous different special- 
ists, As he goes up the scale of consultants, he usually finds an increasing 
degree of all-around competence. But a student of psychology enjoyed no 
such opportunity to learn about human nature from older and more ex- 
perienced men, Ten to one, the head of his department was less interested 
in the behavior of men and women and less expert in interpreting it than 
the average novelist, lawyer, or practical politician. In short, for many years 
there were no college faculties of psychology acquainted with the facts, 
theories, and procedures that were essential to the education of a fully 
responsible, practicing psychologist. 

Ill ihc early thirties, however, the situation began to change: courses of 
instruction became more realistic, more relevant to the concerns of respon- 
sible people. Learning theory, derived from animal experimentation, was 
successfully applied to the facts of normal development and of morbid com- 
plex formation; some of the findings and hypotheses of psychoanalysis were 
cautiously introduced into lectures on abnormal phenomena; the potency 
of cultural forms, of role and status, as described by the sociologists and 
anthropologists was gradually recognized; a more dynamic conception of 
[icrsonality slowly took shn[ic; new tests were improvised which required 
for their interpretation a considerable knowledge of character structure and 
of unconscious processes; promising field theories of determinants were 
elaborated in conjunction with scries of observations of behavior in experi- 
mentally controlled, lifelike situations. 

One result of these and other advances was that graduate students be- 
came progressively more interested in the application of their knowledge 
to human problems, Many of them found positions as applied psychologists 
in such fields as personnel selection, guidance and counseling, opinion poll- 
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tional conflicts and situational diflicuhies, in relatively normal [arsons; 
whereas the psychiatrist will he responsible, as always, for the more severe 
neuroses and psychoses. The psychologist will tie asked to aid in the care of 
the milder disturbances, not only because tlicrc will not be enough psy- 
chiatrists to treat all sufferers, but because tlic psych olttgist’s training will 
prepare him better than the average psychiatrist is now prepared to under- 
stand normal people and their difliculcics, The psychiatrist^s comprehension 
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of personality is apt to be .sDmewhut warped by the operation of barely 
applicable concepts derived from studies of the psychoses. 

As a means of training graduate students as well as physicians in the 
use of concepts, testing procedures, and statistics appropriate to the explora- 
tion of normal personalities, we cannot conceive of a better system than that 
provided by an assessment center. By serving six months or a year as a 
junior assessor, a student could not only acquire most of the technical 
skills accessary for the practice of his profession, but, by regular attendance 
at staff conferences and special seminars, would learn a good deal about the 
process of arriving at interpretive and predictive formulations of personality. 
No other agency could favor him with better conditions for acquiring from 
more experienced seniors some of the wisdom that is not to be found in 
books. 

Because of what it could contribute to the development of more capable 
clinical psychologists and psychiatrists, then, as well as because of what it 
could contribute to the advancement of knowledge through research, an 
assessment institute can be strongly recommended to a university or founda- 
tion; and it can be recommended to any organization which depends for 
its success on highly qualified personnel because of the practical service such 
an institute is capable of rendering. 

RECOMMENDATIONS 

In addition to the few principles of assessment outlined in Chapter 11 and 
the methods described in subsequent chapters, we now have certain pro- 
cedures to propose which arc calculated to remedy some of the defects of the 
system as employed by us. For greater clarity these recommendations will 
be presented as definite rules. Their value, though not yet unequivocally 
proved, seems to us hardly open to question. 

Recommendation i, — Select a staff of suitable size and competence, diver- 
sified in respect to age, sex, social status, temperament, major sentiments, and 
specific shrills, but uniform in respect to a high degree of intellectual and 
emotional flexibility. Because of the existing ideational heterogeneity among 
psychologists and psychiatrists, the nature of the assessment procedures will 
be largely determined by the special theoretical convictions and talents of 
whoever is chosen to direct and plan the program, and this choice is likely 
to be determined by irrelevant or chance factors, since administrators of 
organizations arc rarely, if ever, in a position to judge the relative merits 
of different systems of assessment. It must be understood that what is set 
down in this section is conditioned by our preference for the methods which 
in our experience have proved most effective. 
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reflective introverts^ to middle-class as compared to lower-class persons. But, 
more important than this consideration, is the widely recognized fact that 
every p^sychologist’s understanding of others is constrained in some measure 
by the structure of his own personality and by the necessarily limited range 
of his experiences and acquaintanceships; consequently, the best way of 
arriving at a comprehensive conception and fair estimate of a candidate’s 
character is to give due weight to the judgments of different examiners. 
Sometimes one member of the staff, possibly because of certain dispositions 
he possesses in common with a certain candidate, is better able than anyone 
else to explain this man’s behavior; but this same staff member may be the 
one least fitted to pass judgment on the next case that is discussed. Thus a 
diversity of judges is best when it is a matter of deciding the fate of a 
diversity of candidates. 

Perhaps the most disqualifying attributes for a member of an assessment 
staff are rigidity of mind and rigidity of feeling. A psychologist who be- 
lieves that his conceptual scheme, whatever it may be, is the only one that 
is suitable for formulating personalities, and who finds it difficult to work 
ellectivcly with any other scheme — such a man or woman is likely to impede 
the development of a set of concepts adapted to the special requirements of 
assessment, Rigidity of feeling and of sentiment will make it hard for an 
assessor to adjust rapidly to the great variety of assessees with whom he will 
have to deal. 

Undesirable as assessors are those men whose judgments of personality are 
influenced to an appreciable degree by their own religious, political, class, or 
racial sentiments. It is, of course, extremely important that no candidate be 
given the slenderest reason to suspect that sentiments of this sort will enter 
into the decision that determines his acceptance or rejection. 

Freedom from conspicuously annoying traits might also be mentioned as 
a requirement for a member of an assessment staff, since the cause of 
assessment is not furthered by haphazardly irritating the candidates. 

Recommendation 2. — Before designing the program of assessment pro- 
cedures, conduct a preparatory study of the jobs and the job holders of the 
organization. This study should be considered an essential part of a scientific 
selection program. Several months devoted to it are almost certain to be a 
profitable expenditure. If this is not feasible, the three-day assessment system 
like that at S can hardly be recommended, because if the staff is ignorant 
of the precise needs and standards of the organization, it will be laboring 
under so great a Iiandicap that its decisions will not be worth the cost of 
the undertaking. 

The steps which comprise this preparatory study are defined by the fol- 
lowing eight subrecommendations: 
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Who has been discharged from this unit in recent months? Why was 
No. I discharged? No. 2? And so forth. 

What arc the chief requirements, in your mind, for job A? For job B? 
And sc forth. 

Recommenclatloii ^.3 .— a careful survey, analysis t and classifica- 
Uon of the trifortnaUon obtained by these observations and interviews 
{Rccojnmendations 2,1 and 2.2) mal^e a tentative list of the personality 
determinants of success or failure in the performance of each role. These 
determinants will constitute the variables which, if possible, u/ill be measured 
by the assessment procedures. Besides the single over-all variable, Job Fitness, 
there should be a number of other more specific variables, because, for one 
reason, in order to discover the defects in the program and so improve it, 
it is necessary to predict in what respects a candidate will prove to be suitable 
or unsuitable, as the case may be, and then later to compare these predictions 
with the appraisals given by competent observers. A staff of assessors may be 
correct in a large proportion of its predictions of fitness and yet be wide of 
the mark in the reasons given for each decision. As a result, it may carry on 
for a long time with an unjustified confidence in the efficacy of its methods. 

Most of the variables of personality which are of importance to assessment 
can be .subsumed under one or more of the following five headings: 

i) Dispositions and capacities necessary to perform the functions which 
constitute the proposed job. Ability, or ability to learn, is the basic require- 
ment; but Co receive a superior rating a man should also be interested in 
hi.s work (for its own sake) and/or be highly motivated to do well. 

ii) Emotional reactions to the various physical and social situations the 
candidate is lil{idy to encounter. Determinants in this category should be 
con.sldcrcd in connection with those in the previous one, since every task 
must be executed within certain settings, A man may be able to write 
excellent intelligence reports and he may enjoy company and be very sociable 
on occasion, but yet be incapable of doing good work in close proximity to 
other people. Another man may be very creative in composing propaganda 
script (under favorable conditions), but he may not be creative while living 
in London away from his family, exposed to daily attacks of flying bombs, 
and working under a branch chief who docs not appear to appreciate the 
merit of hIvS ideas* Functional efficiency is sometimes greatly impaired by 
interpersonal conflicts. 

iil) Physical or mental ailments. Under the previous heading we would 
list emotional reactions to environmental situations which occur when the 
man is in relatively good health. These are normal character components. 
Here, on the other hand, we are concerned with^ emotional reactions (to- 
gether with many other things) which fall outside the limits of mental 
health. They are signs of a pathological condition, the definition of which 
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h) Ability to learn to jump from a plane with a parachute. 

i) Tolerance of physical clanger: gunfire, bombing. 

j) Tolerance of physical discomfort: cold, wet, insufficient diet. 

k) Physic.al stamina, endurance, persistence. 

l) Tolerance of strain, hard work, pressure of time, confusion, snafu, frustration. 

m) Tolerance of authority, arbitrary commands, imposed tasks. 

n) Tolerance of neglect, criticism, depreciation, slow promotion. 

o) Freedom from neurotic symptoms. 

p) Attitudes toward Chinese. 

q) Alcoholism, 
and so forth. 

The more specific the variables, the more understandable and useful they 
will be CO men who are untrained in psychology, and the easier it will be to 
estimate them accurately in the field of operations. 

But if sullicient concrete information is not available and if the jobs to be 
filled arc so numerous and varied that a list of variables of this degree of 
specificity would be unmanageable, then it will be necessary to pick more 
general variables, such as Energy and Initiative, Effective Intelligence, Emo- 
tional Stability, and Leadership, the sort that OSS assessment units were 
forced to fall back on. 

Recommendation in words that .are intelligible to members 

of the organ lt::ationt a tentative rating scale for each personality variable 
on the selected list as well as for the overfall variable, fob Fitness. If every 
variable on the list is a distinguishable determinant of effectiveness and if 
the categories composing the scale for each variable are defined in terms of 
degrees of facilitating and impeding influence upon effectiveness (in actions 
of a certain class, in situations of a certain class), the practice of rating 
variables can be strongly recommended. If, in contrast to this manner of 
proceeding, the attempt is made to define and measure isolated traits 
divorced from their interrelations, their connections with specified situations, 
and their effects upon specified performances, the list of scores obtained will 
necessarily be highly abstract and often misleading. If, for example. Emo- 
tional vSiabilily is defined and rated in isolation, the men assigned to the top 
category on this variable will, in all likelihood, be those who have manifested 
the least discernible emotion under various types of stress. Among them one 
would not find General Patton, nor General Montgomery, nor General 
MacArtlmr; one would not find Mr. Churchill, whose passionate eloquence 
sustained the fortitude of our world in its darkest hour. But if Emotional 
Stability is defined and measured in relation to effectiveness of performance, 
then Mr. Churchill might head the list on this variable, since it was precisely 
the Intensity of his emotion, its congruence with each situation, and its 
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but no more. He is moderately able, moderately reliable. He may be superior 
in some respects and unsatisfactory in others, but on the whole he meets the re- 
quirements for his position. Although he has perhaps failed in one or two 
dilHcult jobs, he has performed his routine duties in a reasonably satisfactory 
manner. He has his good days and his bad days. His commanding officer is 
willing to retain him, 

I U Ti satis fdctoty, lafenor . This man has not done satisfactory work. He is 
decidedly deficient in one or more respects — motivation, intelligence, emotional 
stability, social relations, or the special ability that is required of him. Perhaps he 
did well once but his efficiency has been seriously impaired recently by neurotic 
symptoms, alcoholism, or some other deteriorating factor. He has a depressing 
effect on morale and is not respected by his associates. His commanding officer 
wants to get rid of him (or already has got rid of him). 

Since at this punt in the enterprise the rating scale will be used to appraise 
present members of the organization rather than to assess new candidates, 
one category of unsuitability is sufficient. Busy administrators, and laymen 
generally, accortling to our experience, find it difficult to distinguish more 
than three degrees of acceptable competence, and so we would recommend 
starling with a fourqioint scale .similar to the one above, but reworded so 
as to conform to the condilions prevailing in the given institution. 

Recommendation 2,5 * — Devise a satisfactory system for appraising the 
performance of members of the organization both at this time and later. 
The immediate purpose of this recommendation is to discover certain facts 
necessary to the establishment of a frame of reference for the assessment 
process. But; its more important purpose is to construct at this time a satis- 
factory system of appraisal which can be used to test the merit of the 
assessment procedures. This second point deserves special consideration, the 
assumption being that the task of validation must eventually be undertaken 
for one, two, or all of the following reasons: (i) to measure the value of 
assessment as a whole and so decide whether it is worth continuing; (2) 
to measure the efficacy of each test and on this basis decide which ones 
should he retained, which improved, and which eliminated, and thus gradu- 
ally to increase the validity of the judgments; and (3) to verify the scientific 
hypotheses on which certain predictions have been based. 

Since the value of the assessment procedures will be judged by the results 
of the appraisal procedures, the latter certainly deserve as much critical 
attention ns the former; and the recommendation we are making here is 
that this critical attention be given at the very outset. 

One reason for this suggestion is that experience has shown that clinical 
psychologists have tended to devote the greater part of their energies to the 
construction and perfection of testing materials, and to be very scrupulous 
in calculating reliabilities, but, at the last, to be rather uncritical in accepting 



482 


Assessment of Men 


whatever viihdating criteria are readily (jbraiiial)lc; that i,s to say the rle^ 
of scientific soplwstication that I, as been applied to the nssessme ^ 
js mttch greater than has hce.i applied to the appraisal prtiass 1 tf 
act that the proo of the whole enterprise hangs i.pon the tic in I K 
the latter. Ily working out the appraisal procedures at the .start we c- n 
certain that this final phase of the utulcrtaking will he carrictl out as 
factonly, from a sdmiific .stanclpoiai, as the first. 

of 

One should kiiow ahead of time, for example, wlie'tlier thrjarga wipT ' 
an objectively determined figure, such as the number of units owok.i 

S5JSS=:S^:;3Si 

assumptions, sentiments, and tastes ^ ^ assotutics, their 

s:l;'7Tr:ri7-; 

those who would judge him in the future Our T'''""' 

by thoughts such as tliesc “Tliis fellow is I ) 'y'''T ‘"^“^need 

he is not conspicuously j cknv average „ melligence and 

he has an exc ptiona/sensc S li’n K'/f high mark because 

the operationally defined bull's^cvw the ' i' '7 hit 

we had. We aimed at the ideni I n- 

might receive from "a m-oun i-f appraisal that the candidate 

S irom a gioup of omniscient and utterly impartial judges, 



Conclusions and Recommendations 483 

Probably, then, in some instances the assessment was nearer the truth than 
the appraisal 

Since, usihilly, the judges of a man s performance do not agree precisely 
in their cstimaies, the results of the appraisal process might be more accu- 
rately conveyed by a pattern showing the distribution of the ratings, rather 
than by a single figure representing the average or the majority of the 
ratings. 

Disagreement amtnig ajipraiscrs is not always, as we are prone to assume, 
an indication of errors, of the unreliability of the method, errors which are 
due, let us say, to <lifTcrcnces in the number of facts at the disposal of the 
judges, or to the play of different prejudices, or to differences in ability to 
observe l>ehavi()r and estimate effectiveness; disagreement may represent the 
precise truth of the matter. For example, the social relations of a person, 
his effect on others, arc rarely uniform, In general his effect on those with 
whom lie feels congenial will he more beneficent than his effect on those 
whom he flislikes. To test this, one would have to question the people who 
had been affected in one way or another by the man, including in one’s 
sample both friends and enemies. Certainly there would be disagreement 
among the ratings on the variable Social Relations, but if this disagreement 
were accepted as a significant fact and represented by a pattern of judgments, 
instead tif being obliterated by arbitrarily averaging the ratings, the conclu- 
sion reached would corrcsjKind more closely to the actual state of affairs. 
The same applies to tlic variable Leadership, And here we are reminded of 
a certain major who was rated inferior in Leadership by several irate sub- 
ordinates but superior by all those of equal or higher rank. The average of 
these ratings placed him in the middle category on Leadership, a result which 
correspoiuled to no man\s judgment. Unfortunately, we did not appreciate 
the advantages of using a pattern of appraisals until our evaluation had been 
completed. 

Since most roles arc a composite of numerous different kinds of tasks, and 
since a man is not likely to perform all of them equally well, It is usually 
desirable to obtain estimates of his effectiveness in fulfilling each of his 
major functions. And, since the execution of a function calls for repeated 
and varied efforts to deal with different environmental situations, estimates 
of effectiveness should be based, if possible, on the observation of many 
samples of behavior, A man may be skillful in handling Lt. X, but make 
no headway with Sgt. Y; he may l>e adept at repairing a jeep but unable 
to find his way amid the intricacies of more complicated machinery. Equally 
relevant arc judgments of the total organisational efficiency of a man’s day’s 
work, the smoothness of coordination among his several functions and 
several actions. Finally, an over-all rating of total effectiveness must-be 
obtained, due regard being given to the relative importance of each function 
in the fulfillment of the given role. 
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fall into each category. This distribution can be arranged by modifying the 
criteria for inclusion in the different categories^ by lowering or raising 
standards until each category contains the desired percentage of men. Such 
a scale would be suitable for rating Job Fitness, but it might not be appro- 
priate for other variables. It might produce an unwarranted distortion of 
reality, or, for some other reason, prove impractical 

Rccomnicntl*Uion i^.8. Obtain the figut^cs itcccssuvy fov ct brief ttutnerical 
statement of the persormel history of the organization over the last four or 
five years. These figures, wc are assuming, may be extracted from the per- 
sonnel records of the institution. The data rec^uired include (i) the number 
of applicants (recruits) for jobs per year; (2) the number of men accepted 
(hired) per year; (3) the number of accepted men who were subsequently 
dismissed as unsatisfactory and the average duration of their employment; 
(4) the number of accejitcd men who left on their own initiative and the 
average duration of tlicir employment; (5) the number of accepted men 
who have remained with the organization; (6) the distribution of fitness 
racings among tins last group (as found by the above-mentioned preliminary 
appraisal); and so forth. These facts and figures are necessary as a record 
with which the siibsc(]ueiu personnel history can be compared. Without this 
information it, will never he pc),ssiblc to calculate the practical value of the 
assc.ssment progiam. 

Recommeiulation %.--^Design a program of assessment procedures which 
will reveal the strength of the selected variables; for assessing these variables 
set up scales which conform to the rating scales that were defined for the 
purpose of appraisal. Most of this book has been devoted to descriptions 
of assessment procedures; on this topic we have nothing to add here. 
Although some of the techniques used by the OSS staff will prove useful in 
the selection of almost all types of personnel, a fair proportion of the pro- 
cedures which 'will constitute any given program will have to be especially 
designed to fit the requirements of the organization to be served. 

As to the rating scales, our difficulties have led us to suggest a modification 
of the frame of reference which wc used in assessing OSS personnel. Instead 
of judging a candidate in relation to the population of all candidates exam- 
ined heretofore, vve recommend that he be judged in relation to the present 
members of tlic organization. According to this scheme the scale of degrees 
of acceptability used in assessment would correspond exactly m the scale 
of acceptability which was defined after the preliminary appraisal of an 
adequate sample of the membership. For example, if a four-point appraisal 
scale, similar to the one described above, is selected, the three top categories 
of the assessment scale should be identical with the three top categories of 
the appraisal scale. Thus the standard for Superior, Outstanding (category 
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4), will then be a sort of composite portrait of all members ()f the organiza- 
tion who have been assigned to this class by the appraisers; the same would 
go for Very Satisfactory, High Average, and ft)r Satisfactory, Low Average. 
The definitions of each of these three categories should be more specific and 
operational than those given above, and, once adojacd, they should he used 
without moclificalipn for botli assessment and appraisal, 'riius the two rating 
scales for acceptability will be identical. 

For purposes of appraisal one category of unacceptability is probably suf- 
ficient; but for purposes of assessment the number of categories that are 
used to distinguish those who arc below standard will depend on the range 
of inferiority among the candidates. Under smne circumstances one category 
may be .sufficient, but usually it will he advisable define two or three, It 
is conceivable, for example, tliat among a hundred applicants nr recruits, 
none is judged to be suitable for membership in the organizatUMu In this 
case, no correlation between tests would he possible if no tlistinctions were 
made between all these iinsultahic men. As far as ix)S.sible, the degree of 
diflcrence between each of the categories in which unsuitable men are classi- 
fied should be equivalent to that between each of the categories in which 
the suitable men are classified. 

All this applies not only to the definition of the catogtirlcs used in rating 
over-all Job Fitness, but to the definition of those which constitute the rating 
scale for caclt personality variable, livery category on every scale should be 
defined as specifically as jx)ssil)]e in terms of the kinds of observable behavior 
which facilitate or impede cfTcctivencss of total performance. 

At Station S, the start, in the absence of any better criteria, tried t(j judge 
each candidate (in respect to the strength of each variable) against an imag- 
inary normal distribution curve of the candidates who had passed through 
S up to that time. If was assumed that the percentage of men chat fell into 
each of the categories on the six-poiiu .scale would be distributed somewhat 
as follows: 0 and 5, 7 per cent each; i and 4, 18 per cent each; 2 and 3, 25 
per cent each. Although this scale was somewhat incongruent, and the asses- 
sors never adhered to it very closely, it was useful as a rough standard with 
which the actual distribution of ratings could be compared from time to 
time, in order to discover whether the staff was exhibiting a tendency to 
limit its ratings on this or tliat variable to a few categories rather than to 
distribute them over the entire scale. At one stage, for example, it was 
found that a disproportionate number of 4\s and 5*s had been given on 
Motivation, whereas relatively few 5's had been given on Emotional Stability. 
This knowledge led to some clarification of the hulf-conscious assumptions 
which had been guiding our decisions. 

But we are now convinced that this is not the proper way to proceed. The 
standard of comparison for each variable should be the behavior of the 
members of the organization who have been assigned by qualified appraisers 
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(0 each of ihc four caicgorics which constitute the scale for that variable— 
Unsatisfactory; Satisfactory (Low Average); Very Satisfactory (High Aver- 
age); Su[icririr (Clutstandiiig). Since the distribution of the ratings is 
determined to a large extent ity the definitions of the categories, if a particu- 
lar distribution is desired, this, as we have said, can be approximated by 
reoJifyittg definitions. In any case, the obtained distribution of appraisal 
ratings may he used as a rough guide for the distribution of assessment 
ratings, provided that the assessors remember that it is their function to 
increase, if possible, the ntimhcr of members in the higher categories (Very 
Satisfactory and Superior) and thus gradually to change the distribution of 
ratings that was found before assessment was established. This change may 
not he possible. If, for example, the caliber of the candidates is low, but the 
need for personnel is urgent, the organization may even request the assess- 
ment staff to pass men wlio fall in the Unsatisfactory category. 

In brief, tlicn, our conclusion is that the nature of the rating scale-the 
number of categories, the definitions of the categories, and the expected 
distribution of the ratings— should be first determined on the basis of ap- 
praisals of an adequate sample of the existing membership. This initial 
study will define the categories of acceptability. The number of categories 
of unacceptability will dc[)cnd on the spread downward of the variables 
among rejected candidates. We would recommend that the three top cate- 
gories of the as.sessmcnt'appraisal scale be designated by the numbers 6, 5, 
and 4. that is, (5 to stand for Superior, 5 for Very Satisfactory, and 4 for 
Satisfactory. 'I'his will leave three numbers, 3, 2, and i, for designating 
different degrees of unacceptability. We do not recommend continuance of 
the use of 0 (zero) employed in OSS. Some have suggested that a meaning- 
less progression of letters, like J. K, L. M, N, and 0 would be an improve 
ment on numbers, since it would do away with fa se metric assumptions 
about the scale. Finally, since the assessors will f V 

tinguish among themselves more than three degrees of acceptability, we 
of plo, (+) ..J minoq-) .0 

within tach of tho larga categories, h this ™y 1'''“^ =+ faod 
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nothing more than convenient abstract symbols, the clisiulvanlagcs of using 
them will be oiiLWciglicd by the advantages. 

Recommendation \*--‘Build a conce^Hml scheme in terms oj which /or- 
mulations of different personalities can he made. One of the guiding princi- 
ples of the OSS system of assessment was that assessors should reach the best 
possible diagnosis of the personality as a whole before making specific ratings, 
predictions, and recommendations. This rule, we believe, should be retained, 
provided it Is understood that ‘‘personality as a whole,*’ as poliucci out in 
Chapter II, is a very vague notion and that its symbolic representation is 
still very far from being a realizable goal. We lack the ordered knowledge, 
the proper modes of analysis and synthesis, the concepts, the instruments of 
examination, and, in most situations, the time necessary even to approximate 
the ideal* The "best possible diagnosis of the personality" tcxluy would be 
a coherent conception of a few cam|X)ncnts of several ptirpf)sive systems, 
certain striking integrates or complexes, some ouislundiag al>ilitics, a number 
of general attributes, and an indication of the degree of integration, stability, 
and power of the whole. 

But psychologists and psychiatrists are not permanently restricted to partial 
formulations of this sort. One may predict with some confidence that sub- 
stantial progress can be made in the coming yeans if social scientists will 
collaborate in the construction of an increasingly com[)rchcnsivc, coherent, 
and usable theory of personality, the adequacy of wtiicli can be judged by 
its ability to explain the past and predict the future. 

As explained in Chapter II, the OSS staff mcml)crs did not attempt to 
agree upon one explicit theory of personality. They took pains to define only 
those personality variables which were clearly relevant to the immediate aims 
of assessment. When it came to interpreting the behavior of a candidate and 
formulating his personality, each assessor used whatever conceptions and 
terms seemed most suitable to him. Usually he expressed himself in non- 
technical language, using adjectives, metaphors, or trait-names; at other 
times he used scientific concepts. Some assessors would talk quite often of 
mood swings,^ incoherence of thought, paranoid trends; others would stress 
infantile fixations, basic anxiety, and ego-defense mechanisms; .still others 
would be quick to point to evidence of an inferiority complex, social inse- 
curity, ovcrcompcnsatlon, and so forth. But despite a good deal of hetero- 
geneity on the Ideational level, the staff members seemed to undcTsiand each 
other well enough, and very few theoretical arguments occurred to impede 
the progress of the conferences. From this one might conclude that there 
is a considerable amount of concord today among psychiatrists and psycholo- 
gists on a common-sense pragmatic level, although, as we all know, seera- 
ingly radical disagreements arise as soon as the attempt is made to force 
into definitive molds the fuzzy-edged, half-conscious notions with which we 
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operate. Ihc problem is how to arrive at a common conceptual scheme 
which will do justice to all existing sectarian schemes without provoking 
further civil wars among psychoanalysts and psychologists. This must 
somehow be accomplished if further progress is to be made on a large scale. 

Now experience dictates that in situations marked by intellectual confusion 
and dissension it is necessary to go back to the observed events and their 
analysis^ and to define hi operational terms each concept necessary to the 
formulation of those events. This is always laborious and often difficult, but 
in the long run it will save much time by putting an end to much futile 
discussion. In any event, wc would urge an assessment staff to define 
opcratK>nally every concept or variable which it will require in the diagnosis 
of personalities, and to do this before starting their practical operations. 
The system c)f variables will certainly have to be modified as time goes on 
so as to bring it in cvcr-closcr accord with the observed facts: new abstrac- 
tions will be acldetl and old ones revisSed or eliminated. But during any one 
period the cf)nce[)ts used by the staff members in formulating the person- 
alities the candidates should be drawn from those which constitute the 
existing scheme. 

Since most tjf ll)c cnrnpmicnts of personality are forces which vary In 
strength, their dcfiiuiltms should include criteria in terms of which different 
degrees of intensity may he rated. 

Having defined the separable components of personality, the next task will 
be to define the various kinds of relations which may exist among them and 
show how these rlKTcrent relations can affect the perceptible strength and 
modes of expressitm of each force. It is generally agreed, for example, that 
the expression of a strong drive can be so completely checked by an organiza- 
tion of inhibiting forces that its intensity as measured by the usual behavioral 
criteria will tic very low, and yet the strength of the drive may actually be 
greater than it was before Its frustration by the barrier of inhibition. The 
manifestations of its increased intensity are to be found not in direct overt 
actions, but in dreams, fantasies, mental preoccupations, affects, bodily ten- 
sions, psychosomatic symptoms, and in numerous overt though indirect 
forms, such as outbursts of humor. The increased strength of the drive will 
sometimes be exhibited overtly if the barrier of inhibition is suddenly lifted 
The intensity and characteristics of a force can also be modified through its 
fusion or cciUahoration with forces of a different nature. Consequently, the 
original operational definitions of each component of personality taken sep- 
arately must be supidemcntcd by further definitions which describe its 
manifestations when integrated in various ways with other compotients. 

As an llluslration, let us take the so-called Oedipus complex. This is an 
affective complex of a hoy’s personality, formed in early childhood, w ic 
combines a .sex-love fraction directed toward the mother and a jealousy-hate 
fraction directed toward the father. This component of personality should 
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first of all be defined in terms of a list c>[ asccrtainalilc facts, disregarding for 
die moment the operation of other inhibiting or transforming forces. A few 
of the indices of the fathcr-liatrcd fraction might run somewhat as follows; 

1) When he sees his father or thinks of him, die feelings that arise are usually 
unpleasant— "irritation, resentment, rage, or jealousy, possibly accompanied by 
anxiety and fear, or by contempt, 

2) He avoids the company of his father if jHJSsihle (he may do this by 
secluding himself in his own room, or staying away from the house, or leaving 
home); or 

3) Sometimes he seeks his father out in order to ridicule, criiicizc, or hlamc 
him, or to worst him in an argument, or to prove his fathcr\s inferiority (in 
some field of taste or knowledge), 

4) He thinks very often of his father, particularly of those features of his 
character which displease him, 

5) He speaks harshly or derisively of his father to otlicrs, l>clittlcs or accuses 
him, recounts incidents which exhibit the least appc.aling features of his fathcr^s 
character. 

6) He resents and, as far as possible, resists his father's authority: he refuses 
to obey his father or does so reluctantly; he is ncgativistlc and defiant, 

7) He dreams of killing a man who resembles his father. 

And so on. 

These are merely a few of the ways in wliich this component (father- 
hatred) might show itself if uninfiiienced by otiicr components, such as 
father-respect (which might exist alongside nf: fatherdiatied), fear of retalia- 
tion, of social disapproval, of public punishment, or fear of cmiscicnce 
(superego punishment, remorse), and so forth. After defining these latter 
variables in terms of concrete indices, the psychologist should distinguish the 
different kinds of relations which may exist between these com[>oncnts and 
the father-hatred component, For example, there may be incessant conflict; 
or the father-hatred component may be severely repressed l)y one of the other 
variables, and the exact opposite (fathcr-rcspcct) may develop in an extreme 
form', or there may be one or another type of fusion or synthesis of the 
opposites, Each of these different forms must be operationally defined in 
terms of concrete facts, subjective or objective. 

This topic is too complicated to be pursued here, Suffice it to state our 
opinion: that the science of man will prcigrcss nn a wide front as soon as 
social scientists agree on a convenient scheme of critical personality variables, 
defined in operational terms. For assc.ssment this is a necessary preliminary 
to the setting up and verification of hypotheses relative to the influence of 
various components and structures of personality on the effectiveness of 
different types of performances. 

Recommendation 5 . — See up an efficient piinch-card record system which 
will pertmt periodic statistical analyses of assessment findings. It is advisable 
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to have a research unit of two workers who will devote their entire time to 
tabulating ant! iiitercorrelating assessment ratings and correlating these 
with appraisal ratings. This should he done at regular intervals so that the 
staff memhets eau l)c informed of their errors and of the causes of them 
as soon as possihle. Only by providing in this way a rational basis for cor- 
rections can the system of assessment be improved. For the staff, assessment 
is a learning process, a , step-by-step adjustment, by hypothesis, trial, and 
validation, tii the realities of a changing situation. 

The [irtKtcs.s of assesstnent should be organized according to an experi- 
mental de.sign which will allow for analysis of variance and covariance, and 
factor analysis, these being the preferred methods of dealing statistically 
with events that are determined by a multiplicity of variables. 


Recommendation ().• -Assess candidates for a long trial period without 
reporting ratings nr decisions to the organization. The purpose of this 
recommendation is to rletermine how many of the candidates who are 
judged by the assessors to he unsuitable will, if given the opportunity, per- 
form their dufies salisfactorily. Measures of the efficacy of assessment are 
ordinarily h.ised on ftillow-tip studies of the accepted candidates. The sub- 
sequent careers of the rejectees are not traced. What percentage of these 
should have ht-en aecepted? It is important to know the answer to this 
question because it might he found that predictions of incompetence have 
a much higher tlegree of validity than predictions of different degrees of 
competence, and, comseciuently, that the chief value of assessment reside m 
its timvcr to .iiscriminate the least fit rather than in its power to discriminate 
among the fii. (In this connection we might recall here that the usua 
effect of eliminating the men at the lower end of the scale is to reduce the 
corrclatioms between assessment ratings and appraisal ratings and so convey 
the impression that predictions are less valid than they truly are.) 

This brings us to the end of our story, and to a place where a final over-all 
view of our work is in order. Although our performance, as it burned ou , 
was below the expectations which we held at 
the course r>f our assessment activity, we do not believe this to 
cause for discourage merit as wc look to the future, for the resu ts were no 

^"in'thr first place, our methods of appraisal were not dependable, and it 

is po.S.le tlu!t tlK results were better than the 

•second place, not, having been able to find out wia p ^ ® 

personnel proved that assessment 

nroccss. wc have no standard o£ comparison, p ^ n-rpai-lv 

in c»nlrib,.tins to the elficieney of the organtMon by greet y 

reducing the number of failures. 



492 


Assessment of Men 


It is unfortunate that a re.vcarch unit was nut set iip at the start, A rotatinc 
research unit of four men, two to remain in Washingt.m anti two to go 
imtnediatcly to the difleient theaters of operation, would have provided the 
assessors with facts essential to the improvement and final success of the 
program: first, these research meti could have ohtained accurate detailed 
analyses of the propsed jobs and of the environments in which they would 
have to he performed, and thus could have provided the assessor, s with 
clear-cut targets; second, they could have ohtained appraisals of a repre- 
sentative sample of men who had not been assessed and thus .secured a 
stanclaid to which later apftraisals of asscsscrl personnel could liave been 
compared; third, they could have collected reports of the performances of 
the accepted candidates at the OSS .schools in the United States, and later 
ohtained apprai.sals from their supervisors and assrtciates oveisseas, and by 
these means kept the asses, sors currently informed ttf the errors of iudgment 
they were making; fourth, the members of the resc.irch unit who remained 
m Washington could htivc analyzed these error, s ami di.scovercd which 
determinants of success or failure were being overlooketl or overwciglued and 
which techniques were least depcndahic, and tlms initiated improvements 
of method and of judgmeiiL Finally, d^cse faii<lic,s would have. led to die 
development of a satisfactory system of appraisal, and today we would have 
a sound estimate of the value of as.scssmcnt. 


Mo,st of these procedure, s were carried out eventually hut not thoroughly 
enough or soon enough to enable us to derive much benefit from tliem. Wc 
were recruited to perform an cnicieiu service, not to conduct invc.stigations. 
In the light of experience, however, we would emphasize that research is a 
first essential in a new enterprise such as ours. 

It now seems likely that, in the ah.sence of the crucial information which 
a research unit could have furnisheil, our major practical accomplishment 
was confined to the detection of definire signs of motivational, emotional, 
social, or intellectual aberrations or deficiencies, and that this limited ob- 
jective was about as well achieved in the one-day program at W as it was in 
the three-clay program at S. The proper conclusion might he that the more 
comprehen-stve and refined procedures at S yiddeil more unde, .standing of 
the {Ki-sonahties of the candidates than the assessors could make use of in the 
absence of an equally comprehensive and derailed mass of fact.s relative to 
the assignments overseas. If one is asked to select among a large ntimlier 
of posts those which will fit a hole that is ahom five to eight indies in 
diameter, lUs a waste of time and money to do more than deicnninc whicli 
ones fall within these limits. This can be done (itiiekly without mea.suring 
the posts. But. if the exact diameter of each liole is stated and a neat fit 
IS desired, then it is more economical to take the time to measure every post 
With comparable precision. ^ ^ 

Despite the somewhat equivocal outcome of the whole enterprise, we be- 
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lieve that by trials and errors we have exposed and found remedies for 
most of the defects of tlic system, and have finally arrived at a plan as 
promising as any that is known to us for advancing the science of man, a 
plan which contains tlic necessary instruments for its own modification 
and perfection. 
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ASSESSMENT POPULATIONS 


I he C.iblc.S in tlic following appendix are designed to present a 

clescripti(»n nf the chief characteristics of the groups of people who went to S and 
W. Particularly they 5hf»\,v in wluu aspects these populations were specially 
selected or at least atypical* 

Since this intontuititui was collected primarily for the clinical assessment of 
each iiulividuah rather than for use in a census, certain facts are not available 
concerning all camlid.urs, Moreover, since wide latitude was allowed each candi- 
date in rdling out his Personal History Form, and since various revisions were 
made in this qurstioiinairc, information was sometimes obtained which was in- 
complete or could ni^C ivc litted into certain rigid categories. Also certain problems 
arose in coding (he ilata for IHM analysis. Despite these faults, the information 
collccteil [(resents a rcasonahly accurate picture of the large groups studied at S 
and W. 

Ivach table shows the t(Ual numlH:r (N) of cases on which its percentages are 
based. Several of the iV’s are within a few cases of the whole sum of assessed 
individuals; most the represent 8o per cent to 90 per cent samples; and 
only twii iV's are lif low [Kir cent of the total population. The total S population 
was ar\d die total W [K)f)ulation was 3,071, including 52 assessed twice, at 

lK)ib areas. 

llte general [uqitilalion data for the United States employed in the tables to 
follow were obtained from the published summaries of the Sixteenth or 1940 
Census data assenihleil by the Bureau of the Census.’- 

In making comparisons iKlwccn these data on the country as a whole and 
the total available pipuhulons of areas S and W, differences existing among the 
three po[udations in the percentages of each sex represented have with one excep- 
tion Ivcrn disregarrlrd, kcausc these differences were unimportant. If the sexes 
were ctmq^arrd ?;rjiaratdy in all but this one case, the resulting findings would 
dilfer in no 'ugnillcaiu way from comparisons of the total populations. The 
cscejuion to ihU is ibc tabic on income (Table 44). Since the wages ot women 
are so much lf>wrr than those of men, tlic marked difTcrcnces in the percentages 
of the sexes in the three jwipulations must be allowed for in comparing these 
groups, 

^Popuhthn, Unilcfl Ssaia Sutnuury, Sctonil Series, Chamclcmtics of the Populathfh and 
iNdf Pan i, Vn3. Ill, The hihot Tone, 
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COMPARISONS BF.TWI'FN THF I'ni'ft ati, iv. , 

the POPUr^ATlON OP THE EN-I7KI iSrrto 


I here can he no ilouht iliai tlir ;iA'.rA’.r<i m!-,,,.,,- , 

than the avcraijc Arneriem k li.,.;.. i- ^ '"‘‘’’’"I'fllitan 

were more than fipy (liifcre,,. , 'i, ’ '■ ' r''b'Kh<t j’naip. ai„| (l,„c 

=«bicc„' ™ i r I., 

Turkish, an.l Arabic; / t ' 

Dutch. A candidate saii ir.he (tr l"'' -Malay, and 

have a good command of (iandaidian wL'rArmLil N. ' 

StateV before johiing ('As ' Onr lUih"! "l ‘ '"“'air the t'nited 

sphere. Approxinut ; -fwr rountrics in dds hrnti- 

lands of tL or t.u,re S i e A 

foreign countries was only a few momhri'l^ ' ffshh'ncc in 

!Sd" “f"™' » "A z; 

group with cxtrSnarT SSraurinlLAr’S 'r''"' 
than S candidates, a cliiwimm S T 

Hie data are presented in Table at. ‘ 'u thrtr gmerally lower job status. 

Although the group of catidklaics at W In, I .. f. ■ 
the S group was almost ill mile •m I ' i i rrpresentatioti of Imih ttexc.s, 
the last sevAal mond ’s. to S in 

on^the'Siage ‘they're mAVTlifr''’!'*^ 'o"' 

result of differences in cultural hcritim ' S'7' 'M’''“'icans to a,ssc.ss, as a 

The most striking dispantv be 

g spanty between the assessed group and the general Ameri- 
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TABLE 41 

Comparison, by Distribution, of the Assessed Populations with the Total 
Population of the United States 


Arc 

(in yc^rs) 

u.s. ^ 

(ifi md over) 

% 

S (N= 1 , 344 ) 

% 

W C:N= 3 ,o 60 
% 

t8‘ Lo 

7‘9 

1. 1 

1.6 

2.Q 24 

12.4 

19.9 

28.6 

’• 5 - ' 2-9 

II. 8 

26.9 

28.4 

V> -34 

10.9 

10.5 

10.0 

33 -39 

i 10. 1 

13.4 

II. 2 

4 " 44 

i 9'4 

7'9 

6.1 

4 S 34 

16.5 

8.1 

3*4 

;md over 

; 10.9 

1 

1.1 

0.7 

Total 

i too.o 

100.0 

100.0 


TABLE 42 

Comparison, l^y P.dncational Auaimnent, of the Assessed Populations with the 
Tcual Population of the United States 


' 

Ycjirft of school ioiuphtd^l 

U.S. 

% 

S(N=i,343) 

% 

H 

il 

Hlemencary .sclund or less. , . 

59'5 

1.6 

2.1 

school: 




I cu years 

15.0 

5 '^ 

3-9 

4 vears 

14.1 

14.2. 

19.6 

Coll eye 1 



26.4 

I to ] years 

5-4 

i 3'5 

4 years or more 

4.6 

55-5 

47-9 

Not reporcej 

1.4 



Total 

j 100,0 

100.0 

100.0 

Four years of colkye, or graduate work: 

16.1 

17.1 

Graduate work without degree * 

10.3 

8.5 

Master’s degree 



5'3 

4-3 

Doctor's degree or equivalent 

13.8 

8.0 

Total 



55'5 

47-9 
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can population was in criiuationa! astaininrnr. ’A'lnlc kt .toi nt .!,» 
population 1U.VC had no ntorr than dct.rntary -.ho-.! chtcathm. 

■'.lar.toBsraiBKs a,o ,l.c ,s aa,l tr.'i 

’ Ta,.!a ,a Lr^' 

In 'I'ahlc 43 the groups that altrn.lnl S .nn! W .ur uuntuicrl with -U . , 
census figures of the United States in terms of ,.. u,...,ional grmtp,. ^ 
Because (ii^f llic great need for spe. ial talents and traniiar in nSS it i< 
prtstng to find in professional fi'l.ls a trnn !, lamer ,, a" n, 'f he ""i 

dtrical workers in the W di.slrilnitmn unesnr. ted. sinee (nic ,if thr' (■„„ ,• ^ °! 

w waa .1,0 p,o,,a,,,rf;,.da,» f 

a,. C.U the ,-a,os,„ic, of ,!,a ilt" 

'rAIfLI- ,,3 

I,, „„ a, i„„, 

the loial 1 (ipnhttion of the United Kiatcs 


Major occii|'atinnal ftnuip 

Professional workers J 

Semiprofcssional workers . .'i 

Propriecors, managers, and od'n ials, | 

including farmers 'f 

Clerical, sales, and kindred workers '■ 
Craftsmen, foremen, and kindred j 

workers 

Operative and kindred workers. 
Domestic service workers, .... 
Service workers except JomesVic.’ ' 
Laborers . . . 


Total . 


tl s 


fi.^ 

I .c» 

iy.4 

1 6.7 

l l.fi 

18.3 

•17 

7-S 

11.3 


ino.o 


38.9 

‘\'7 

ly-J. 

^,0 

0. 4 

4A) 

1. i 

UKlaCj 


w 


17.6 

5*5 

■IV9 

S.u 

^ 4 
oa 
VI 
i.H 

UK^.O 


tojai "f i'< 

foreign-language typesetters ami hUt ' ^ niaker.s and cennomists, 

.ivL“S,I'S;SS^ T 
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incomes before of tfu: fcnmlcs seen at S and W were well in excess of 
women's salaries ).;rnrrally mul rouj^hly equivalent to the male income distribu- 
tion for the U.vS. llic most striking diflercnccs were in the highest income 
brackets, bor instancr, per cent of the males in the S group and 6,4 per cent 
of those in the W group had top incomes over f5)Ooo a year before 1940, but the 
ccnstis listed only i..j per rent of the males in the general population as being 
in this range. T\\v ligurrs pre‘;fmcd in Tabic 44 indicate that the assessed popula- 
tion hud dciiiiilHy been rct ruilcd iroiu high- income groups. 


TABLE 44 

Comparison, by Income,* of the Assessed Populations with the Total Population 

of the United States 


1 

1 

Ud 

3 . 

SCN=- 

1.533) 

■WCN= 

1 . 794 ) 

i 

AnniuS incunie 
(iri difdbff.) 

Mii!d 

t'f 

Female 

C' i 

. (1 ^ 

Male 

:;n=i,46)) 

% 

Female 
(N= 7 o) ( 
% 

Male 
^N= 1,100) 
% 

Female 

CN= 594 ) 

% 

bjo inciune (snulunc) 

i 

< 

h 

34'9 

18.6 

18.4 

17*7 

dtlitr 0- 7y9 

h 

\ 

h 

4,0 

8.6 

4.1 

7'9 

Total u 7yv 

] 

Cifi.a 

38.9 

17. 1 

31.6 

15.6 

8(X) 

i i 7«7 

18,7 


17. 1 

8.1 

19.0 

i,i(K) 

; 163 

S .7 

10. 1 

ii.8 

I 5-3 

lO.X 

t,6c'Ki i.yyy 

1 K.K 

VO 

7 .x 

14.3 

10.9 

11.6 

ijOCK) 1,499 

: ("xy ' 

1 1.6 

8.8 

7-1 

10.7 

7'4 

5 -.W 9 

' 2.*7 1 


6.3 

5.7 

5.0 

3’5 

3, (XX) ,|,yyy 

3 -^ 

0.6 

11.3 1 

1,9 

II . 0 

i '4 

5,o<K) and over 

i ^-4 i 

O.I 

11.3 

1,9 

6.4 

0.3 

5 »(KKr 9,999 

1 ) 

l> 

8.1 

Z .9 

4*7 

0.3 

lo.cxK) aoil ov(.‘r 

! 

i 

1 ) 

4.1 

0.0 

1*7 

0.0 

Total ((iXcliKliiip first 
two and last two 
lin(;.s). 

{' " ' ' 

1 

1 

s 

i 

,j tCX ).0 

100,0 

100.0 

100.0 

100.0 

100.0 


* Tor die jn-'rr.’t'-ii jiMpul.uirui'i iiunnif! i^i defined ;is the hirgest amount received by an. indi- 
vuliKil from lib (iriniriiy inb lirf^rr 
nut avriibhlr, 


In summary it can Iw; said that the facts [ircscntcd in tlus appendix indicate 
that the canditlatr.s wlio came to assesvsmcnt had already been highly selected, 
and, measured by a iiumlKr of customary standards, were In general of upper 
socioeconomic status. 
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COMPARISONS HETWI-KN TUK poPDI.A'rif >NS OF S AND W ON 
VARIOUS ASPECTS OF THE ASSICINMF.NTS PRoPfiSIU) FOR 
TFIE CANDIDA'PES 


Every branch of OSS was ullowccl to choost* ilu: abscssinnu sratmn to which 
it sent any given candidaia But, as n rule, the l)rancli ohirrrs followed the 
directive issued at the time that vSialiori W was rstablished, Staiiijn W was set 
up CO relieve Station S of three classes of candidates: (i) those who would \k 
subjected to little stress overseas; (ii) tluvse lower echelon personnel whose work 
involved limited responsibility; ami (iii) those few* who, Ivccause (Jl the press of 
circumstances, could not spare three days for assessment. To some extent, W also 
handled the overflow which could not he fitted into the S scliedulc, 'I'hat the 
policies sec down were largely carried out is rcllccicd in die tables IkIow. 


I'ABI.E *15 

Proposed Position in F'icUl at 'Pirnc of Assessment® 


Position 

S 

CN- 876) 

Rear base 

I x 8.7 

7'3 

Advanced base 

Front, or behind enemy lines 

42.7 

United States 

6.1 

Undecided. 

17 

“Not behind enemy lines" 

13-4 

Total 

1 CX 3 .D 



W 

(N« ' x»r‘yi) 


74.0 

5-7 

14.8 

^‘3 

0. 3 

1. y 

kk).o 


® These data should be imcrprcted with cautiori hr^'.^lJr^r dit'y vveie dririvrd foun fr.iHi»irnwry 
descriptions oE proposed jobs which frc(|uc‘iuly did not make ilic hK.dr ile.ir. 


Table 45 shows that three out o£ every four W subjects were scheduled for 
assignment at rear bases, whereas half of the S students were proposed for duty 
at advanced bases or behind enemy lines. 

Closely related to this difference in proposed position is the fact demonstrated 
in Table 46 that nine out of ten S cases were in the military service, whereas 
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nearly one in three W students was a civilian, many of these women, who were 
]U)t sent near the Irom. 


table 46 


Service Status at 

Time of Assessment 


Statu *> 

! 

s 1 

CN= 1,654) 

% 

W 

(N= 1,163) 

% 

Ollicor 

51.0 

18,4 

Enlisted man 

40.7 

40,3 

Civilian 

8.3 

31-3 

TocjI 

100.0 

1 

xoo.o 


S haiitlk'd two executives or officers of the middle echelon for every one seen 
at W, while W assessed almost twice as many candidates for lower-echelon posi- 
tions. I'hcsc facts, presented in Table 47, fit in with the data of Table 46, show- 
ing that (jnc out of two S subjects was an officer, while at W the ratio was only 
one otii of four, 

Analyses of the representations of the various branches of the organization at 
S and W must lx* made with the realization that each branch was free to send 


TABLE 47 

Pro[)oscd Echelon at Time of Assessment* 


Ihancli 

1 

s 

(N« 1,037) 

% 

w 

(N=i.Si3) 

% 

Higher: senior executive, high 



command 

1.8 

4.6 

Middle: junior administrator, sub- 



ordinate command 

60.1 

19.8 

Lower: ofl'ioe worker, member of 

1 




36.3 

65.3 

Undecided 

0.8 

0.3 

To till 

100.0 

100.0 


“These clatii sliould be interpreted with caution because they were derived from fragmentary 
descriptions of proposed jobs which frefjucntly required the assessment staff to guess in which 
echelon they would fall. Moreover, the staff was not always clear as to the distinctions between 
die echelons and lienee there were undoubtedly inconsistencies in their judgments. 
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its candidates to whichever school it wished) and sometimes made the choice [ot 
various reasons of expediency. Also it must be realized that many sorts of training 
were provided in each branch. However, certain generalizations can be made from 
Table 48. 

TABLE 48 

Branch Affiliation at Time of Assessment 


Branch 

S 

(Ns 1,341) 

% 

'W 

(N* 3,011) 

% 

Research 

i '5 

10.6 

Intelligence 

30.7 

11.4 

Operations 

14.4 

14.4 

Propaganda 

ZI.l 

6.6 

Services 

1-9 

zo.o 

Other Branches 

19.3 

16.0 

Total 

loo.o 

100.0 


It can be concluded from these data that S usually saw those faced with 
hazardous duty (Operations), those who were recruited for work requiring a 
wide range of ability and flexibility (Intelligence), and those expected to engage 
in creative activity (Propaganda). For understandable reasons it was harder for 
a man to succeed in the branch devoted to propaganda than in any other branch. 
The W staff, on the other hand, saw fewer such people, but more who were to 
do research, carry out services, or be administrators at rear bases. 
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rnMPARISONS BETWEEN PERFORMANCE ON STANDARDIZED 
TKSTS of S and W populations and GENERAL NORMS 
^ FOR THE TESTS 


At various times a number of standardized tests of intelligence and skills were 
included in batteries used at S and W. Generally these were restandardized on 
an assessment population and the raw scores then converted to the assessment 
tiv-ooint scale. The norms for the general population were disregarded as irrele- 
vant for the exceptional groups seen at S and W. It is profitable and mstructiye, 
however, to compare the distributions of raw scores of the assessed subjects with 

the norms for these testSi « v , u i 

The Army General Classification Test (Form ib), given to all personnel enter- 
ing the Ariny, was administered to 123 subjects selected at 

o/successive classes. A comparison of the scores of this sample with die AGCT 
theoretical curve of normal distribution, which the grades for the vvhole Army 
aoDro?mited, enables us to contrast the test intelligence of S candidates with 
that of the Army. In making the comparison it must be emphasized J^at the 
sample was composed of approximately 90 per cent service personnel, most 

TABLE 49 

n nf the Theoretical Distribution of Standard Scores on the Army 

the Popuktion Assessed at o 


Standard score on 
AGCT 


S 

CN*I^5) 

% 


140-15 9 

110-139 

100-119 

80-99 

60-79 

40-59 
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whom had taken the same test or some form of it previously. Even if considerable 
allowance is made for practice effect, it is, however, still evident that the S average 
was far above the Army average. The figures are presented in Table 49. 

The Atwell-Wells Wide Range Vocabulary Test was administered at S for 
some months. The words on this test are arranged in order of increasing difli- 

TABLE 50 


Comparisons of Distributions of Total Scores on the ACE between a Repre- 
sentative Sample of College Freshmen and the W Population 



Men 

Women 

Raw scores 

Freshmen 
(N= 1,011) 

% 

w 

CN=i. 588 ) 

% 

Freshmen 

(N=S, 775 ) 

% 

w 

(N=8i4) 

% 

100 

0.0 

0.0 

0.0 

0.0 

190-139 

0.0 

0.1 

0.0 

0.0 

00 

H 

1 

0 

00 

H 

0.0 

1.6 

O.I 

0.4 

I 70-1 7 9 

0.5 

3.8 

0.1 

l.I 

160-169 

0.9 

74 

0.7 

6.0 

I 50-1 5 9 

3.0 

10. 1 

1.0 

8.6 

I 40-1 49 

6.4 

ii.i 

4'5 

II.I 

130-13 9 

II . 4 

II. 4 

8.9 

13.9 

110-119 

i4.i 

13.0 

II.I 

13. 1 

110-119 

16.6 

II. 6 

14.8 

11.4 

100-109 

15.8 

7.8 • 

14.8 

10.7 

90- 99 

11.8 

7.1 

13-4 

7.6 

80- 89 

7-9 

5.0 

II.I 

5-3 

70- 79 

4-7 

3'3 

6.9 

3.8 

60- 69 

1.8 

1-9 

4.9 

2-7 

50- 59 

1.6 

0.9 

1.9 

l.I 

40- 49 

0.9 

0.9 

1.6 

0.6 

30- 39 

0.4 

0.9 

0.7 

0.4 

10- 19 

O.I 

0.4 

0.3 

O.I 

10- 19 

0.0 

0.3 

O.I 

0.0 

0- 9 

0.0 

O.I 

0.0 

0.0 

Total 

100.0 

100.0 

100.0 

100.0 

Average raw score — 

no. 7 

12.4.4 

104. 1 

110.8 

Standard deviation of 
raw score distribu- 
tion 

14.7 

3Z.0 

16.4 

19.7 
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Itv and the raw scores can be converted to norms for various educational levels. 
Tn average adult score may be considered as in the neighborhood of 50, according 
to the published instructions. The S candidates included a number of foreign 
born to whom English was a second language. Nevertheless, a sample of 215 S 

. TABLE 51 

Comparisons of Distributions of Scores on the Quantitative Section of the ACE 
between a Representative Sample of College Freshmen and the W Population 
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TABLE 52 

Comparisons of Distributions of Scores on the Language Section of the ACE 
between a Representative Sample of College Freshmen and the W Population 


Raw scores 

Men 

Women 

Freshmen 

CN=i,on) 

% 

W 

CN=i.5S3) 

% 

Freshmen 
CN= 6,775) 

% 

W 

CN=8i9) 

% 

110 

0.0 

O.I 

0.0 

O.I 

115-119 

0.0 

i '9 

0.0 

1-5 

IIO-114 

0.1 

47 

0.1 

5.0 

105-109 

0,3 

6.7 

0.5 

6.1 

IOO-104 

0.6 

6,1 

I.l 

7.1 

95- 99 

1.9 

8.6 

1,1 

9.6 

90- 94 

4.0 

8.3 

37 

10. 1 

85- 89 

6.1 

8.8 

5’4 

7'5 

80- 84 

7-4 

8.8 

7.8 

8.3 

75- 79 

8.8 

7.1 

9'5 

10.3 

70- 74 

II.O 

9.0 

10.5 

6.6 

65- 69 

11,1 

6.1 

10.7 


6b- 64 

11.9 

6.0 

10.8 

37 

55- 59 

10.4 

4.8 

9.9 

5'3 

v-rt 

0 

1 

9.1 

3-5 

9.1 

37 

45- 49 

5-4 

3-5 

6.6 

1-5 

40- 44 

4.1 

1-9 

5 - 2 ^ 

2-7 

35- 39 

1.4 

1-3 

3.0 

1.0 

30- 34 

1.6 

I.O 

1.8 

0.6 

15- 19 

0.8 

0.8 

0.8 

0.4 

10“ 14 

0.4 

0.5 

0.6 

0.6 

15- 19 

O.I 

O.I 

0.3 

0.0 

10“ 14 

O.I 

O.I 

0.1 

O.I 

5 - 9 

0.0 

O.I 

O.I 

0.0 

0- 4 

0.0 

0.0 

0.0 

0.0 

Total 

100.0 

100.0 

100.0 

100.0 

Average raw score 

66.1 

79.1 

65.6 

81.1 

Standard deviation of 
raw score distribu- 
tion 

■ 

13.7 

17-3 

11. 1 


















Appendices 


509 


ability and skill in handling quantitative material, are explored in this scholastic 
aptitude test, resulting in a point score. In Tables 50, 51, and 52 the W raw 
sLre distributions in terms o£ percentages are compared with those of a repre- 
sentative sample of college freshmen.^ It will be observed that while Ae W 
ffroups have higher average scores, their range of variation is greater. The hnding 
■< in accord with the wide distribution of the educational attainment of the vV 
group, which included candidates who never reached high school as well as 
others with doctoral degrees. 

It will be noted that the W population was unusually able in the language 
section of the test, but hardly above the average freshmen on the quantitatwc 
section. Because of the large groups Involved, the averages are highly ^I'^bje 
for the language and total scores, the differences between the means for the 

SThe sample of college freshmen is that used in the preliminary report of norms for the 
1943 edition of this test. 



APPENDIX B 


THE INTERRELATIONSHIPS AMONG THE VARIABLES 


Intercorrelations. — The variables on the final rating sheet were originally 
selected, not to represent independent characteristics, but to embrace the essential 
qualifications for most OSS work. In view of this condition and the fact that 
each was a composite of the various aspects listed on the report scale, it is not 
surprising that these variables showed considerable interdependence. A represen- 
tative set of their intercorrelations is given in Table 53 below, which is based 
on a population taken from the last twelve full-length classes at S, a period 
during which Energy and Initiative was a separate variable on the final rating 
sheet. Omitted from the group were all men for whom any final grade was 
missing, the chief influence of this selective principle being to exclude men older 
than thirty-nine because they were not allowed to run the Obstacle Course and 
were not rated on Physical Ability. 

The first eight variables in Table 53 are those listed on the final form of the 
report rating sheet. While Observing and Reporting and Propaganda Skills were 
not reported because they were relevant only to specific assignments, they were 
routinely rated to help provide a basis for two of the recommendations on the 
check sheet. The “Over-all” rating was a staff decision recorded for research 
purposes only and broadly defined as an estimate of the individual’s maximum 
possible contribution (past or future) to the welfare of mankind. Because of its 
unique nature, it is not included in the calculation of the median intercorrelation. 

The median of all values in Table 53 (omitting Over-all) is .33, which indicates 
some lack of independence among the variables. Aside from those for the rather 
specific and homogeneous grades on Physical Ability and Security, the medians 
arc all of about the same size. It is noteworthy that these same two exceptions 
show the lowest correlations with the Over-all rating, which is itself highly 
related to all the other variables. 

The relatively great communality among the variables is due to several influ- 
ences. One is the fact that all grades were based upon behavior noted during the 
brief time-span of three days. While the object was to predict the candidate’s 
reactions during the next few years of service in OSS, the basis was an observa- 
tion period of less than sixty waking hours. Although the interviewer sought 
to rate on the basis of past history, the data on that history were reported by 
the candidate during the assessment period and were probably influenced in 
some slight degree by the candidate’s contemporary attitudes such as his desire 
to get into OSS, his desire to make a favorable impression, his approach to the 
unique assessment situation, Inevitably in several psychological measurements 
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made at the same time, there is the common effect of extraneous influences tech- 
nically known as ‘‘error” factors because they interfere with the attainment of 
“true,” unbiased measurements. This consideration is even more important in 
the situation ratings which contributed to the final grades. Of the total of more 


TABLE 53 


Intercorrelations among Final Variables 
= — All Men in Latest Group of Classes Rated on all Variables) 



Motivation 

Energy & 
Initiative 

Effective 

Intelligence 

■a 

■§s 

s s 

Ui 

a 

0 

3 a 

Q 

(U 

1- 

•4 

1 

1 

1 h' 

£ < 

’u 

u 

bo 

fl a 

'E 'H 

u 0 

A 

0 

Propaganda 

Skills 

"rt 

0 

Motivation 













for Assign- 








.16 





meat 

— 

•47 

•31 

•43 

•39 

•44 

• 2-7 

•^•3 

•37 

.41 

Energy & 











.36 


Initiative, . 

•47 

— 

.56 

•53 

.38 

•71 

•45 

.11 

•31 

•54 

Effective In- 








.06 


.63 



celligence. . 

•31 

.56 

— 

•^3 

■ 5-7 

.65 


.70 

,70 

Emotional 













Stability. . . 

•43 

•53 

•13 



.62. 

.48 

•34 

•37 

.11 

.11 

•47 

Social Rela- 


1 







1 


.18 


tions 

•39 1 

.38 

•17 

.6i 

— 

•44 

.38 

•33 

■35- 

•57 

.63 

Leadership, , . 

•44 

.71 

.65 

.48 

■44 

— 


.11 ' 

.16 

.31 

•55 

Physical 












,11 

Ability 

.16 

.41 

.06 

•34 

•38 

,zx 


•13 

.07 

.18 

-.07 

Security 

•2.7 

.11 

.11 

•37 

•33 

.16 

•13 


.11 

.19 

Observing 













& Report- 









.18 


•53 

•53 

ing 

•’■3 

• 3 ^: 

.63 


■ 3 ^ 

• 

35- 

.07 


Propaganda 





00 




7 .11 

,19 

•53 

■53 


•59 

Skills 

Over-all 

•37 

• 4 ^ 

• 3 ^ 

•34 

0 0 

.11 

■47 

•35 
. '63 

-.0; 

.11 

•59 

Median Inter* 
correlation 

•37 

.41 

•31 

■37 

.38 


■44 

.11 

.11 

•31 

.36 

•54 


than fifty separate scores entered on the candidate’s summary rating sheet *e 

majority were made in eight situations, so that the same extraneous 

due to any given situation affected several scores usuajy 

For example^f a candidate was restrained at the Brook by a d' 

dirty objeas, he migk receive generally lower ratings ^ 

grade warranted. Or a candidate coming out of a Personal His y 
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with a number of vivid new self-insights might be preoccupied during the 
Discussion situation and fail to do his best. 

Another general influence upon all of a candidate’s grades was the S staff’s 
total reaction to him. Not only did the staff concentrate its attention on the basic 
question of his suitability for work in OSS, but also, especially in the final staff 
conference, there was a general tendency to consider him an outstanding fellow, 
an average GI, or an unfortunate misfit. While the staff members were fully 
aware of this halo effect and sought to minimize it, they could not abolish it, 
Finally it must be remembered that psychological research has almost always 
found positive relationships among abilities and among socially desirable traits, 
While a comparison between the degree of these relationships in this study and 
in others cannot be made without a careful analysis of the relative ranges of the 
abilities or qualities, the size of these intercorrelations is not unusual as compared 
with other relevant researches. 

Factor Analysis.— In a field like personality, factor analysis is an especially 
appropriate technique since it is a method for discovering basic factors or elements 
in a set of measurements. Although the assessment program was not designed to 
afford data for factor analysis, it represents one of the first attempts to measure 
abilities and traits in a series of lifelike situations, and for that reason an analysis 
of its variables may yield suggestive results which would serve as the basis for 
further investigations. 

Using the above intercorrelations, a factor analysis was performed to produce 
further information on the variables themselves by bringing out recognized and 
unrecognized central factors running through them. It is immediately obvious 
that the results are not of general applicability because the data were obtained 
under the unique conditions of wartime assessment for overseas work in OSS 
and because some of the variables are peculiar to that situation, e.g,, Motivation 
for Assignment and Propaganda Skills. Furthermore, the data are not well suited 
for a factor analysis; the number of subjects (133) is not great, the number of 
original variables is only eleven, and each variable is itself a composite of several 
scores with only moderate degrees of interrelationship. Bearing these considera- 
tions m mind, we can examine Table 54, which shows the obtained factors and 
their loadings. The heaviest loadings are italicized.^ 

Factor A has been labeled Adjustment because it embraces not only emotional 
adjustment as measured by Emotional Stability but also social adjustment or 
Social Relations. It might also be called Adaptability because it has loadings on 
Social Relations and Security, both of which require a modification of one s 
behavior to conform with external requirements. The finding of a factor common 
to both Emotional Stability and Social Relations is not surprising because the 
latter can be conceived as highly dependent on the former. Although the incln 
sion of Security may be less expected, it is consistent with the nature of the Are; 
variables. Security involved the ability to assume a role more or less at varianci 
with one’s true identity and the ability to control one’s behavior sufficiently t< 
avoid revealing certain information regardless of the intensity of one’s desire t( 
^The technical reader who is interested in the centroid matrix and the transformation matrl 
will find them in Tables 56 and 57. 
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impress or convince another. Good Social Relations also require a control over 
inappropriate asocial impulses and an ability to fit one’s self into the group even 
at the risk of losing part of one’s individuality. Emotional Stability is in part 
emotiqnal control and in part maturity, which includes the capacity for looking 
at one s self objectively. There are therefore common elements in the three vari- 
ables. It is noteworthy that the next highest weight is on Motivation for Assign- 
ment. While this specific variable is not well represented in any factor, its highest 
loading is on Factor A. Perhaps high war morale and a desire to serve in a 


TABLE 54 

Factors and Factor Loadings 

{Italicized values are for variables on which factors have high loadings) 


Factors 

A 

Adjustment 

B 

Effective 

Intelligence 

C 

Physical 

Energy 

D 

Authoritative 
Assert ioD 

Motivation for 
Assignment 

,l6 

-.03 

.16 

.10 

Energy & Initia- 
tive 

.00 

,00 


.42 

Effective Intelli- 
gence 

-.l8 


.14 

.14 

Emotional 
Stability 

.46 

-.09 

.11 

.04 

Social Relations. 

.40 

.14 

.OX 1 

-•15 

Leadership 

.03 

M 

•3; 

•39 

Physical Ability,. 

.05 

— .10 


-.04 

Security 

.41 

— .Ol 


— .06 

Observing & Re- 
porting 

.01 


-.08 

-.07 

Propaganda Skills 

.09 

.42 

-.13 

.XI 

Over-all 

•14 

^45 

.06 

.05 


special war organization represent a type of adjustment to wartime conditions 
and social pressures in the United States. 

The second factor is definitely Effective Intelligence, which has loadings on 
the variable of the same name and on the two specific aptitudes for intelligence 
and propaganda work. Most striking is its sizable contribution to the Over-all 
rating, which has negligible weights on the other factors. Apparently the rating 
on this general variable was determined primarily by the candidates ability.^ 

The third factor has been labeled Physical Energy because it has high loadings 
on Energy and Initiative and on Physical Ability. The latter variable has no 
other significant loadings. While Factor C also has a loading on Leadership, it 
appears to be determined principally by the other two, and this particular loading 
seems to be based on the energy necessary to maintain leadership, especially in 
the leaderless situations of assessment. 
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The fourth factor, tentatively called Authoritative Assertion, has loadings on 
only two variables, Energy and Initiative and Leadership, (While both are also 
weighted with Factor C, the two factors have a negligible intercorrelation.) The 
first variable contributes the initiative to the assertion. The authoritative aspect 
is derived from the small loading on Effective Intelligence, while the other small 
loading, on Propaganda Skills, reflects the ability (and perhaps the desire) to 
influence the behavior of others. 

Most of the intercorrelations among the various factors are fairly sizable, as 
shown by Table 55. The Adjustment factor is highly correlated with the Physical 
Energy factor, possibly because physical energy assists tlie process of adjustment 
but also (and more likely) because a satisfactory adjustment allows potential 
energy to be utilized for odier purposes because it is not drained off by unsolved 
problems of adjustment. The correlation between the Adjustment and Effective 
Intelligence factors may be attributed in part to the fact that Intelligence aids in 
personal and social adjustment and, conversely, adjustment permits the effective 
exploitation of capacities. The correlations between the Effective Intelligence fac- 

TABLE 55 

Intercorrelations of Factors 



_ A 

Adjustment 

B 

Effective 

Intelligence 

C 

Physical 

Energy 

1 

D 

Authori- 
1 tative 
AssertloD 

A. Adjustment 

— 

.58 

,70 

.06 

B. Effective Intelligence 

.58 


■37 

.48 

C. Physical Energy 

.70 

•37 

_ 

.09 

D. Authoritative Assertion 

.06 

.48 

.09 



tor and the Energy and Assertion factors may be related to the use of several 
leaderless situations where the candidate with ability could readily show initiative 
and assert leadership. 

The extent of these intercorrelations is slightly greater tlian those for the eleven 
variables and reflects the same influences toward a “halo effect." 
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For those readers who are interested in the details of the factor analysis of the 
anal variables, the following tables are presented. 

TABLE 56 

Centroid Matrix 


Motivation for Assignment. . . 
Energy & Initiative 

Effective Intelligence 

Emotional Stability 

Social Relations 

Leadership 

Physical Ability 

Security 

Observing 8c Reporting 

Propaganda Skills 

Over-all Rating 


.171 

.099 

-.^^0 

.414 

.188 

-,095 

,451 

.116 

-■349 

-.478 

-.194 


-.051 

-•437 

-.141 

.113 

■V5 

-.197 

-.185 

.188 

.igo 

.103 

.101 


.108 

.046 

-.054 

.063 

-.090 

.090 

-.194 

.095 

-■137 

.114 

-.074 


TABLE 57 


Transformation Matrix 
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INTERCORRELATIONAL MATRICES 


TABLE 58 

Incercorrelations of Final Ratings^ 

(Periods F-G; N=j97 to 443) 


Variable 

Effective 

Intelligence 

•gr 3 
a ^ 

(fl 

§ 

'3 ’S 

CO cd 

Leadership 

Physical 

Ability 

Security 

Observing & 
Reporting 

Propaganda I 
Skills 1 

Effective Intelligence 

Emotional Stability 

Social Relations 

Leadership 

Physical Ability 

Security 

Observing & Reporting 

Propaganda Skills 

Median correlation with other 
variables 

M 

•31 

.63 

.03 

•32- 

.65 

.66 

•2-4 

•54 

•45 

•31 

•32- 

•15 

.09 

•31 

■54 

•47 

■31 

■32- 

•2-7 

• 2-9 

.63 

•45 

•47 

•2-3 

.16 

.40 

.48 

.03 

•31 

■31 

•2-3 

.06 

.10 

-.14 

• 32 - 

•32- 

•32- 

.a6 

.06 

.2.6 

.30 

,65 

•15 

■2.7 

.40 

.10 

.x6 

•57 

.66 

.09 

• 2-9 

.48 

-.14 

.30 

•57 

•32- 

•32 

•31 

■45 

.10 

.30 

.Z 7 

.30 


Median of all correlations between these variables is .31. 

• Modvation for Assignment and Energy and Initiative are omitted because they were 
combined in Period F and separated in Period G. For intercorrelations between these two vari- 
ables and others in Period G only, see Table 3, page 238, and Table ii, page 263. 
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TABLE 59 

Intercorrelations of Energy and Initiative Ratings 
{Period G; 1^=74 to 


Test 

W rQ 

u flJ 

^ 5 

rt 'G 

•9 q 

PL M 

.SI 

> 

u 

s 

c 

VH 

Brook 

d 

0 

u 

q 

u 

u 

d 

0 

U 

a 

Td !S 

tfi 

.S?-0 

« ci 
\n oj 

< 1-1 

Obstacle j 

Discussion 

Debate j 

Final Energy & Initiative 
grade 

— 

.78 

.67 

• 5 ^ 

•77 

.41 

•55 

•54 

Interview 

.78 

— 

.60 

•43 

.69 

•31 

.46 

.50 

Brook 

■67 

.60 

— 

.36 

.6i 

•37 

.15 

.19 

Construction 

.56 

•43 

■36 

— 

.38 

.19 

.19 

•31 

Assigned Leadership 

■77 

.69 

.61 

.38 

— 

■ 2-5 

.41 

.48 

Obstacle 

•41 

.31 

•37 

,19 

•^3 

— 

.07 

-.09 

Discussion 

•55 

.46 

•^5 

.19 

.41 

.07 

— 

•49 

Debate 

,54 

.50 

.19 

• 3 ^ 

.48 

-.09 

•49 


Median correlation with other 
tests 

.56“' 

•44 

1 

• 3 ^ 

•34 

•43 

,11 

•33 

.40 


Median o£ all corrclarions between tests is .37. 
“Median correlation with final grade. 
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TABLE 6i 

Intcrcorrelations of Emotional Stability Ratings 

{Periods P-C; N=-/iO to 442) 


Test 

Final 

Emotional 

Stability 

grade 

Interview 

1 

Construc- 

tion 

Stress 

1 

Post-Stress 

Final Emotional 






Stability grade 

— * 

.90 

.44 

.46 

.36 

Interview 

.90 

— 

•39 

1 

•31 

.18 

Construction 

•44 

•39 ' 

— 

.36 

■15 

Stress 

.46 

•31 

.36 


•^5 

Post-Stress 

.36 

.18 

•15 

,X 5 

Median correlation with 






other tests 

• 45 “ 

•31 

.36 

•31 

.15 


Median of all correladons between tests is .30. 
‘Median correlation with final grade. 
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table 62 

Intercorrelations of Social Relations Ratings 

{Veriois F-G; N=/7j » 


Test 

Final Social 
Relations grade 

& 

t 

a 

0 

0 

u 

cq 

Construction I 

Discussion 

Debate 

Assigned 

Leadership 

Ratlr 

Asso 

Pos. 

gsby 

dates 

Neg. 

Final Social Relations 
grade 

— 

.69 

.50 

•39 

.51 

.56 

.56 

.61 

•55 

Interview 

Brook 

Construction 

Discussion 

Debate 

Assigned Leadership .... 
Ratings by fPos. 

Associates [Neg 

Median correlation with 
other tests 

.69 

.50 

•39 

• 5 ^ 

.56 

.56 

.62. 

•55 

•43 

•37 

.48 

•49 

•51 

.41 

•31 

•43 

.36 

•33 

■31 

.50 

.19 

.13 

•37 

.36 

.19 

.11 

.30 

.17 

.06 

.48 

•33 

•^9 

.40 

.40 

,16 

•17 

•49 

•31 

.11 

.40 

•33 

.30 

.30 

•51 

.50 

.30 

.40 

•33 

,30 

.08 

.41 

.19 

•17 

.16 

.30 

.30 

•49 

•31 

.06 

■17 

.30 

.c8 

•49 

.56“ 

•43 

•33 

.19 

•33 

•31 

•33 

.30 

•17 


Median of all correlations between tests is .30, 
Median correlation with final grade. 
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TABLE 63 

Intercorrelations of Leadership Ratings 
(Periods F-G: Nsaaj lo 442) 


Test 

i 

rt ^ 

15 ft, 

■la 

W lA 

1 

A 

Brook 

d 

0 

B 

1 

1 

Debate 

a * 

• M 

11 

^8 

^■a 
'a 2 

c 2 < 

Final Leadership grade 

B 

•79 

.68 

•54 

.64 

.66 

168 

.65 

Interview 

■79 

— 

•57 

m 

.48 

•47 

•53 

•54 

Brook 

.68 

•57 

— 

m 

•47 

.41 

.41 

.41 

Construction 

•54 

•44 

•37 

m 

•30 1 

•33 

•33 

.14 

Discussion 

.64 

.48 

•47 

.30 

1 

.56 

•37 

•41 

Debate 

.66 

•47 

.41 

•33 

.56 1 

— 

•39 

•51 

Assigned Leadership 

.68 

•53 

.41 

•33 

•37 ' 

•39 

— 

•37 

Ratings by Associates 

.65 

•54 

•41 

.14 

.41 

.51 

•37 


Median correlation with other 









tests 

. 66 ‘ 

.50 

.41 

•33 

•44 

•44 

.38 

,41 












Median of all correlations between tests is .41. 
‘Median correlation with final grade. 
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Assessment of Men 


TABLE 64 

Intcrcorrelations of Physical Ability Ratings 

{Periods F-G; N=i7^ to jao) 


Test 

Final 

Physical 

Ability 

Grade 

Interview 

Obstacle 

Course 

Athletic 

Events 

Brook 

Final Physical Ability 
grade 


.65 


,66 




•54 

.58 

Interview 



.56 



Obstacle Course 

Athletic Events. . . . 

.05 1 

‘94 

.66 

.56 

•52- 

•55 

•53 

•51 

Brook 

• 5 ^ 

•55 

— 

.38 

Median correlation with 
other tests 

.50 

•53 

•52- 

.38 


.66“ 

•53 





•55 

•52- 

•52- 


wistiduujis Dciween ccs 
Median correlation with final grade. 


TABLE 65 

Intercorrelations of Security Ratings 

{Periods F-G; N=2jo to 440) 


‘Median corrcladon with final grade, 


tests is .19. 


Test 

Final 

Security 

grade 

Interview 

•Stress 

Post- 

Stress 

Ratings 

by 

Associates 

Final Security grade 

— 

.6i 

■44 

.48 

,67 

Interview .... 






Stress. . . . 

,02. 

•44 

•2-9 

•2-9 

.15 

.38 

Post-Stress . . . 

— 

.05 

.zo 

Ratings by Associates. . . 

.40 

.67 

•25 

.38 

.05 

.10 

.18 

.18 

Ndedian correlation with 
other tests . 

•S 5 ‘ 

•2-9 





.lo 

•25 

.10 
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TABLE 66 


Intercorrclations of Observing and Reporting Ratings 
(Piriods F-G; N=200 to 


Test 

»,• 

'Efc 

0 - 
s ^ 

u 

• H 

C 

bO 

fl 

0 

sS 

M 

w 

Terrain 

“S' 

gs 

V) 

0 

'S 

^ s 

M ua 

U 

S s 

U'g 
.D ti 

Final Observing & 




.63 


,64 

.63 


Reporting grade. . . 

— 

.67 

,61 

.48 

■47 

.i6 

Interview 

■67 


.41 

•37 

.14 

■33 

,41 

Belongings 

*61 

.41 

— 

•33 

•^3 

•34 

■31 

rt 

.14 

SIX-1 

.63 

■37 

•33 

— 

•M 

.16 

.i8 


Terrain 

.48 

.14 

.13 

.15 


•M 

.10 

,14 

Memory Battery . . . . 

.64 

•33 

■34 

.16 

.15 


•37 

.30 

Names & 

Identifications . . , . 

.63 

.41 

•31 

.18 

.10 

•37 

— 

‘^9 

Brief Case (Period F 
only) 

•47 

.16 

.14 

•13 

.14 

.30 

.19 

— 

Median correlation 






.31 

.30 

.11 

with other tests . . . 

.63“ 

•35 

.31 

■17 

.14 

_! 


Median of all correlations between tests is ,26. 
•Median correlation with final grade. 
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Assessment of Men 


Test 


Final Propa- 
ganda Skills 
grade. . 


Interview. . . 

OWI 

Manchuria. . , 
Discussion . . . 
Debate 


Median corre- 
lation with 
other tests... 


table 67 

Intercorrelations of Propaganda Skills Ratings 

{Period F; N=/a6 to ago) 


Final 

Propaganda 





■" 

Skills 

grade 

Interview 

OWI 

Manchuria 

Discussion 

Debate 

— 

.70 

.66 

.83 

.69 

.63 

.70 

.66 

.83 

.69 

.63 

.40 

.61 

•75 

.58 

.40 

.44 

.41 

.30 

.61 

.44 

.50 

•37 

•75 

.41 

.30 

•S 3 

' .58 

.30 

•37 

•35 

.69a 

.60 

.40 

■47 

•51 

.46 


a\r j" '•Wijwduuns Dctween tc 

Median correlation with final grade. 


(Period G; N=itg to 


Test 

Final 

Propaganda 

Skills 

grade 

Interview 

OWI 

Manchuria 

Final Propaganda Skills 
grade 


.69 





.66 

.84 

Interview 

OWI 

.69 

__ 

.41 

•33 

.38 

Manchuria, , . 

.bb 

.84 

.41 

— 


•53 

.38 


Median of all correlation, between te.t. i. ,^ 2 . 

1 



INDEX 


Abiliries, appraisal, 398, 445-46 
assessing, ii, 16, 20, 47, 218, 225, 455, 
488 

average, dependent on population size, 391 
executives, 428 
for given roles, 476-77 
interrelationships, 36, 512 
mechanical (see Mechanical aptitude) 
mental, 264-65, 267^2, 450 
on motivation, 242-43, 251, 254-55, 2571 
261 

Oriental, 351-52, 361 
and performance, 117, 423 
psychological, 429 

special, 23, 41, 64, 213, 216, 227-28, 272, 
353 » 381, 394. 484 
staff’s, 56, 74» 121, 220, 423, 474 
varied, 25, 30, 35-36, 42, 132 (See also 
Skills) 

Abstract Intelligence Battery, 377, 379^80 
Acceptance^ by associates, 185-86, 486-87 
OSS standard of, 23, 452, 455 
Achievement, candidate, 218, 322-23 
past, 54, 1 1 8, 222, 245, 439 (See also Ex- 
perience, past) 

Action (see Behavior; Performance) 

Activities, off-duty, 478 
Adjustment ability, assessing, 17, 19, 33 * 39 j 
70, 80, 221, 223, 466, 435 
via Debate, 179 

emotional stability and, 282-83, 286, 291 

energy and initiative on, 264 

F Area test, 402 

factor analysis, 512-14 

foreigners’, 18 

Interview, 117 

and motivation, 252, 257 

Orientals*, 416 

past history of, 114, 289 

on social relations, 295, 300-301 

staff's, 226, 475 

Administrative oflicers, branch, functions, 29- 
32, 55, 61, 188, 21 1, 218-19, 427-28, 
451. 455 » 461 

and job descriptions, I3-I4» ^7 
placement, 236, 33 *"32 
prediction errors, 456-57 


Administrative officers — Continued 
recruits, 316 
social rcladons, 295 
Administrators, organization, 29 
OSS, role of, 6, 25, 31-32, 54 , 269, 35 ^, 
397 * 459 * 461 
Aerial Erection Test, 368 
Age, candidate, 25, 95«., 361-62, 368, 388, 
402, 499 

on intelligence, 273 
on motivation, 241, 247, 258 
Oriental deference to, 351-53 
population sample distribution, 419 
staff’s, 204, 473^74 
Agent’s Room Test, I 5*“53 
Aggression, 180, 245, 251 1 257 p 330 
Agility, assessing, 31, 227, 270, 400 
Far East, 37 *. 379 . 385 
Obstacle Course, 164-66 
Alcoholism, and appraisal, 408 
and assessment, 53, i 74 » * 7^-77 
American Council on Education Psychological 
Examinadon (ACE), 82, 321, 506-509 
American Institute of Public Opinion (Gallup 

339 ^ a Q 

Anxiety, assessment, 70, 78, 121, 285-86, 2H9, 


292-93 

Construction Test, m 
F Area, 402 
Improvisations, 174 
Interview, 117 
Oriental, 356* 389 

rating errors, 447 . ^ • 

Stress Interview, 137 (- 5 " Tension; 

Fear) 

ppraisal, of assessment, 9 * 22-23, 349* 392 - 

449. 477-78 . , . 

assessment v. appraisal ratings, 423-3 ^ 

findings, 423-35 

four techniques, 3 97 - 4 * 7 . 42* 

motivation, 248, 459-^2 

population v. rating analysis, 417-22 

rating reliability, 399 * 4 i 3 , 

Reassignment Area method (see Reassign- 

ment) o 

setting up pre-system of, 29, 5 &- 57 * 44 ^^ 
460. 481— Sdl 486 
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Index 


Appraisal — Continued 
small sample analysis, /;35-48 
technique faults, 406-16, 417, 423, 459, 

484-85, 491 

Theater Commander {see Theater Com- 
mander) 

Appraisers, number and quality, 414, 482, 484 
ratings, 411, 415-16, 421-24, 426 
technique, 413-16 
Aptitudes {see Skills; Abilities) 

Area F {see F Area) 

Arithmetic Test, 376 
Army, Chinese, 353, 372-74, 382-86 
Japanese, 372, 386 
U.S., OSS recruitment from, 59 
screening, 291 

tests, 277-78, 336, 505-506 
Assessment, and appraisal rating, 421-22, 
423-31, 481 

candidate knowledge of, 62 

Chinese Army Officers, 382-86 

conditions of on candidates, 451, 457-58 

cross-cultural, 18 

clementalisdc, 39-40, 48, 50-53 

environment for, 23-24, 33-34 

evaluation of, 392-449, 481 

Far East, 350-91 

future of, 462-93 

Hsian, 386-90 

India, 350, 353 - 55 * 364-72 

Kunming, 372-82 

multiform organismic (Gestalt) system, 28, 

38-41. 43. 50-53. 57 

populations, 497-509 
principles of, 26-57 
records of, 490-91 

S Station formulations and ratings, 203-315 
time shortage, 441-43, 448 
W Station, 316-32 

work in for psychological training, 473 
WS Station, 332-48 

Assigned Leadership Tests, 147-59, 228, 232, 
262-63, 273, 279-80, 297, 301, 303-304, 
307-309, 385, 517-18, 520-21 
Assignment {see Jobs) 

Associates, appraisal, 22, 398, 424 
ktdtude during tests, 37 
judging of, 182-87, 413, 448, 478, 482 
ratings by, 520-22 
Athletic ability {see Physical ability) 

Athletic Events Test, 188, 197-98, 522 
Atmosphere, assessment center, 33-34, 120- 
21, 200, 225 

Attitudes, appraisal, 402, 408, 444, <147 
toward assessment program, 93, 201-202, 
350 

toward Construction Test, 120-21, 225 


Attitudes — Continued 
Debate, 177, 180 
at Discussion,, 130 
on emotional stability, 289 
Far East, 352, 357-60, 368, 379, 387 
Improvisations, 171 
at Interview, 115-17 
motivation, 237, 252, 258, 284 
OWI Test, 124 
Personal History Sheet, 510 
Projective Questionnaire, 90 
returnee, 415 

Sentence Completion Test, 71, 89 
similar for similar situations, 73 
social relations, 295 
staffs, 36, 354, 475 
testing, 69-70, 227 
W Station, 327 
WS Station, 336 

Authoritative Assertion factor, 514 
Averaging, score, 206, 215-17, 280, 313, 
380-81, 506 

Background {see History) 

Ball and Spiral Test, 322-24, 325-26 
Baseball Game, 197-98, 224 
Behavior, Agent’s Room Test, 152 
appraisal, 402, 407, 444, 446, 483-84 
Brook Test, 96-99 
Construction Test, 1 10-13 
Debate, 178 

determinants of, 468-70, 472 
Discussions, 130, 132 

emotional stability, 282, 285, 288-90, 294 

environment on, 29 

factor analysis, 512, 514 

Far East assessment, 357, 360-61, 371 

foreign, i8, 351-53. 356. 368, 370 

at Improvisations, 171-77 

intelligence on, 267, 275 

Interview, 116-19 

leadership, 301-303 

observation of, 39, 49-50, 68, 72, 213, 244, 
392, 438, 460-61, 471, 486 
Obstacle Course, 164-65 
personality sketch, 54, 21 1 
psychological study of, 466, 469-73 
rating, 32-33, 203, 205, 206, 510 
social relations on, 344 
Stress Interview, 137, 146 
testing, 37-38, 216, 218, 227-28, 293, 327, 

332, 395-96 
Wall Test, loo-ioi 

Belongings Test, 91-92, 189, 224, 310-11, 
313* 338, 343 “ 44 » 434 * 5^3 
Bias, appraisal, 403, 405, 407-408, 414, 422, 
482-83 
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Bias — Continued 
candidates’, 30, 69, 180 
by clothing, 221 
not in elemcntalist tests, 40-41 
stai^, 22, 130, 218, 220, 255, 258, 294, 442, 
448, 51 1 

Block Counting Test, 377 
Block Design Test, 358 
Brainstorms {see Improvisations) 

Bridge Building Test, 153-35, 32a, 324-26, 
345. 375. 378. 383-84, 388-89 
Brief Case Test, i8g, 310, 313, 336, 337-338. 
434, 523 

Briefing, 61-63, 316 

British War Office Selection Boards, 14, 18, 
148^. 

Brook Test, 95-99> 100, 129, 147, 228, 232, 
273-77. 279-80, 2 97> 301, 304» 306-309, 
345. 434. 511. 517-18. 520-22 
Burma Tovvn Test, 345 
Burmese, as assessees, 350, 352, 356, 361, 372 
Burmo-Americans, 361 

Cable Report Test, 338-43 
Calcutta, assessment, 353, 356, 361, 366, 372 
Candidates, anonymity o£ "cover,” 21-22, 207 
evaluation of each other, 21 1, 223, 298-99, 
329-30, 368, 385, 478 
long trial assessment of, 491 
motivation, 233-62 

number and flow of, 24-25, 382, 455, 465, 
474 

Oriental, 361-64, 374 
position at S, 221-24 

quality of, 15, 20, 23, 29-31, 41, 231, 247, 
277, 281, 428-30, 465, 474, 486 
recruiting, 58-61 
S staff evaluation of, 203-21 
staff interrelations, 198, 224-27, 290 
test discussion, 120-21, 145-46, 225-26 
Capacities {see Abilities) 

Cases, borderline, 218-20, 354, 364 
incomplete, 437 

unsatisfactory, 425-28, 451, 455-56 {See 
also Failures) 

Ceylon, assessment at, 350, 352-64 
China, appraisals, 398 
assessment in, 350-55, 372-86, 391 
language, 362 

recruitment, 351, 356, 361-62, 364 
Chinese, assessors by name, 373 
behavior, 352-53, 368, 370 
as raters, 381, 383, 386 
social relations with, 296 
Civilian Personnel Branch, OSS, 60 
Civilians, appraisal, 418 
assessment of, 63, 503 


Civilians — Continued 
motivation, 235, 241 
OSS recruitment, 60-61 
Class, assessment type, 15, 24. 957*., 185, 231- 

3a 

Cl iff Scaling Test, 388-89 
Close Combat and Weapons course, 359 
Clothing, at assessment, ai, 63, 221-22, 317- 
18. 331, 334. 366 
Coat Hanger Test, 347-48 
Code Aptitude Test, 1 6, 366, 369-70 
Code Training Course, 359 
Colombo, assessment, 35a, 361 
Combat experience, 361, 372, 382, 418 
Commanding officers, appraisal, 22, 42, 398, 
402-403, 407-408, 415, 418, 420-21, 
423-26, 492 

overseas information, 29 {See also Theater 
Commander Appraisal metliod) 
Commando training, 373-74, 376 
Committee Report Test, 338-39 
Compass, use of, 359-61 
Compedtion, 52, 174, 197, 222, 302, 327, 
347. 371 

Complexes, 47, 54, 250, 468, 471, 488 
Compromise, Chinese use of, 353 
Conference, staff, appraisal, 406, 416-17, 422 
Ceylon, 361 
future, 464, 473, 488 
Kunming, 376 

S Station, 55-56, 95n., 177, 188, 197-98, 
204, 206, 211-12, 212-21, 228, 279, 419, 
512 

W Station, 316, 322 

Construction Test, 35, 102-12, 198, 200, 287, 
291-92, 262, 264, 297-98, 301, 303, 309, 
517, 520-21 

Contacts, informal, 24, 33, 121, 205, 213, 
222, 286, 429, 464 
Cooperation, Agent’s Room Test, 152 
Assigned Leadership Tests, 149-50, 159 
Brook Test, 97-98 
candidate, 23, 31, 93, 222, 354 
Discussion Test, 13 1 
Far East, 359. 378 
overseas appraisal, 398, 400 
returnee, 415 
staff, 26-28 

Correlation, assessment v. appraisal ratings, 

392-95, 421-25, 427-32 

personality variables, 36, 238, 262-64, 275- 
77, 284, 294-95, 301, 306-309, 314, 381, 
397, 430 - 3 r, 510-15 
ratings, 22, 418, 5^6-24 
Courage, appraisal, 400 
assessing, 31, 227, 268 
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Courage— Cow 

Far East, 35 i- 53 » 3^31 378 -^ 9 , 3 ^^* S®?* 

389 

motivation, 245 
on Obstacle Course, 164-66 
Courses, Oriental training, 35^-57 
Court Test, 199-200 

Cover, names, 21, 62, 66, 214, 221-22, 3 i 7 » 

319 

story, 21, 64, 65-66, 69, 93 > ^32-- 

33. 135. i38-42» M 5 -- 47 . * 5 ’. 168-69, 

17J, 180-81, i87» 198-99* 207, 292, 317* 

Criteria, joint for assessment and appraisal, 

417, 421, 449-50 
personality variables, 33 
rating, 57 i 397 

Criticism, Assigned Leadership Tests, 149* 
I 5 I* * 53 * * 55 * *58 
Construction Test, 103, uo-n 
Discussion Test, 132 
Dugout Test, 347 
Improvisations, 173-7^ 
of OSS, 401, 4*5 
testing, 97, 229, 456 

Cultures, on assessment, ii, 18, 25, 350, 352- 
53 * 35 ^ 

candidate sensitivity to, 122, 124 
on intelligence, 276 
in Interview, 115 
and motivation, 248 
Oriental, 352* 357 * 372 * 416 
on personality, 467, 47* » 49 ® 

Daring (/ee Courage) 

Data, for appraisal, 56-57 
for assessment, 3^* **4i *88* 203-205, 209, 
215* 464 

candidates' collection ability, 267-70 
Debate Test, 173, 177-81, 185, 206, 233, 237, 
262-63, 272-73, 279-80, 293, 297, 299 ) 
301, 303-305, 307-309, 432, 434 * 5*7- 
18, 520, 524 

Decompression, value of, 120-21, I 45 — 4 ^* 
225-26 

Democracy, motivation for, 380, 244, 249, 
253, 255, 260 

Demolitions Test, 371, 388 
Dependability, Far East, 35 *> 363 
Designs tests, 358, 377 * 379 , 381, 384 
Director, S Station, 63-64, 68, 201-202, 218- 
20 

Disagreement, appraisers, 406, 483 

psychologists and psychiatrists, 46-48, 83 
staff, 26-28, 130-3** *71, * 74 , 206, 212, 
217 , 26a, 437* 488 


Discussion, appraisal stan, 400, 4 * 5 * 432 
assessment staff, 51, 53 * 55 - 56 , 74, 20O, 
208-209, 212-14, 218, 228-29, 363, 275, 

4*9 

candidate-staff, 101, 120-21, 145-46, 125- 
26 

Debate Test, 177-81 
Far East, 351, 358, 388 
WS Station, 336, 338, 345 
Discussion Test, 93, 129-32, 147, 179, 233, 

237, 262-63, 272-73, 276-77* 279-80, 

297, 301, 303-304* 307-309* 336, 367* 

384, 434* 5*2, 5*7-18, 520-21, 524 
Donovan, Gen. William J., 4, 6 , 10, 25 
Draftees, 247 

Drinking habits, 53 * * 74 , * 76 - 77 * * 8 o- 0 i, 

225, 293, 402, 408, 478 
Drive, assessment errors in, 439 
Interview, 117 
and motivation, 261 
Obstacle Course, 165 
personality, 46, 72, 489 
Dugout Test, 346-47 

Duty, motivation, 242, 244-45, 249-50, 253- 
54, 258, 260-61 

Editorial Test, 343-44 

Education, and assessment, 83, 115* ** 7 » 258, 
288, 498-500, 509 
Ceylon test, 358, 361-62 
China, 352, 382, 387-88 
F Area, 402 
Kunming, 374 -- 75 , 379 
Educational Level Battery, 376 - 77 * 379 - 8 * 
Effective Intelligence (see Intelligence) 
Efficiency (see Performance) 

Egocentficity, 46-47, 447-48, 468 
and failure, 442 

motivation, 245-46, 249-51* 253-55* 257 
staff's, 56 

Emotional stability, Agent's Room Test, 152 
appraisal, 400, 404, 408-409, 430 - 3 *> 439 * 
444, 446-48 

assessment, 13, 30, 33, 35 * 47 * 53 * 70 » 121, 
281-95, 427* 44 *- 43 , 479-80* 486, 492 
Ceylon, 351. 358, 360-61, 363-64 
Chinese officers, 384 

Construction Test, 102, 105, 2871 

291-92, 298, 519 

correlated witli other variables, 284, 294-95* 
5 * 1 * 519 
Debate, 293 

energy and initiative on, 263-64 
F Area, 402 

factor analysis, 5*2-*J> 5 *5"* 6 
health questionnaire, So 
Hsian testing, 389 
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Emotional stability — Continued 
Improvisations, 175-761 ^93 
India, 35 i» 37 ° 

influences on, 21, 454, 456, 477 
and intelligence, 274, 294 
Interview, 116-19, 285-90, 294, 519 
Kunming, 351, 379 
on leadership, 294, 306-307 


Energy and initiative — Continued 
scoring, 214, 232, 510 
Sentence Completion Test, 72 
sta£E's, 56, 121 
W Station, 327 
Enlisted men, appraisal, 418 
motives, 241, 246 
rating of, 22, 60, 318, 395, 413 


and motivation, 238, 248-52, 254-57, 261, 
282-84, 286, 289 
physical ability and, 294 
Post-Stress Interview, 138-39, 141-42, 287, 
293t, 519 

Projective Questionnaire, 90, 288 
propaganda skills on, 295 
rating, 214-16, 230, 287, 43<J-3i» 433 
S Station, 281-95, 427, 430-31, 486, 488 
and social relations, 300-301 


status, 63, 503 

Environment, adjustment to, 179, 466 
of assessment, 3, 5, 23-25, 33 “ 34 j 4^5 
early, 117, 300, 352, 402 
on emotional stability, 283-84, 289, 477 
F Area, 402 
Far East, 352, 357 
for future assessment, 464 
inadequate information on, 9, 29-30, 393- 
94, 438, 449, 457. 459. 4761 49 i 


of staff, 473 

Stress Interview, i 33 » 136-38, 287, 292, 519 
W Station, 328 

Work Conditions Survey, 288 
Emotions, controlled, 30, 136-371 284-86, 
292-93, 295 » 513 
Endurance, appraisal, 400 
assessment, 30-3 33> 270, 458 
Far East, 371, 379 
Obstacle Course, 164, 166 
Energy and initiative, appraisal, 398, 446 
assessment, 13, 30-31, 36, 53» 222, 226, 
228, 479 

Assigned Leadership Test, 149, 151, I 53 - 
55 . 517 

Brook Test, 96-98, 147, 5^7 
Burma Town, 345 
Ceylon, 351-52, 361 

Construction Test, 102-103, 112, 262, 264, 

517 _ . 

correlation with variables, 262-64, 5^^. 
516-17 

Debate Test, 178, 517 
Discussion, 129-30, 147, 262-63, 517 
factor analysis, 513-15 
India, 351-52, 37 ° 
intelligence on, 263-64, 274, 276-77 
interpretation, 262, 264 
Interview, 5^7 
Kunming, 351-52, 375 . 378 
on leadership, 149. i 53 '“ 55 > 263, 306- 

307 Q 

toward motivation, 233, 237-38, 249. 258, 
262-64 

Obstacle Course, 262-63, 517 
past history, 114 
on performance, 46-47. 456 
physical ability, 263 
on propaganda skills, 263 


on intelligence, 254, 272 
lifelike tests in, 37-38, 464 
on performance, 51, 114, 483-84 
on personality, 44-45 
and social relations, 300 
varied, ii, 80 

Errors, appraisers’, 394. 406-16, 422-25, 483 
assessment, causes, 17, 393 . 422-25, 459, 
461, 480 

assessment rating, 19. 32. 55 - 56 , 281, 

391. 394 . 413-14. 433 . 438, 452 i 5 ^^ 
correcting, 465, 492-93 
on foreigners, 18 
leniency (see Leniency, error) 
percentage of, 454 
procedural, 28, 458 
via rating records, 491 
Escape motive, 242-43, 246, 249-52, 254 - 55 . 
257, 259 

ETC, appraisal, 22, 398, 45 ^ 
performance, 232, 416, 424 
returnees, 349. 401 . 4^6 
Evaluation, of assessment, 392-449 
atmosphere on, 226 
emotional stability, 288, 290 
errors, 435-49 

Far East, 351-52, 358 , 368. 375 

motivation, 238. 248-64 

of observing and reporting, 216, 3 ”-i 3 . 

340, 342, 476 
Oriental ability, 352, 368 
over and under, 461 

S staff, 19, 203-204. 206, 212-21, 225, 419 
small sample analysis, 435-48 


WS staff, 335 . 344 
Executives, at OSS, 269, 428, 500 
RxDericnce. combat, 283, 361. 37 h 382, 4 


informants', 4^7 
motives, 242-43. 


145. *55. 3 J 7 . 
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Experience — Continued 
past, 36, 90, n3, 115, 183, a28, 273, 288- 
90, 402 {See also History, past) 

S stag's, 204 

F Area, appraisal, 401-403, 415-16 
purpose of, 349, 401 
ratings, 424-25 
schedule, 402 
Factor analysis, 512-15 
Failure, candidate reaction to, 72, 93“94, 121, 
139, 164, 292 

Failures, causes of, 435, 438-49, 450-52, 459 
field, 9, 19, 424, 425-28, 461 
inevitable percentage of, 451-55 
recording of, 213, 491 
specific skill lack, 17, 455-58 {See also 
Cases) 

Family, attitudes on, 72, 74, 83, 115, 117 
effects of, 52, 54, 1 4 1, 221, 352, 402, 454 
on emodonal stability, 288, 290 
identity secret, 21 
on social relations, 300 
Far East, assessment, 350-91 
assignment for, 241, 349, 401, 415-16 
tests for, 232-33 
Fascism, 235 

Fatigue factor, appraisal rating, 405, 412 
on testing, 52, 72, 173, 335 
Faults {see Errors) 

Fears, assignment, 237-38, 240 
Interview, 115, 117 
on motivation, 242, 250, 258«., 260 
Oriental, 358, 389 {See also Anxiety; Ten- 
sion) 

Figure Analogies Test, 358 
Filing Test, 322, 326-27 
Finance, on motivation, 242, 246, 250, 253— 
54» 352 

Flagpole Test, 378 

Flashlight Observation Test, 232, 338, 343 
Foreigners, assessment problems, ii, 18, 71, 
83, 95«., 498, 507 
motivation of, 235, 244 
Formulations, S Station, 203-29 
Frame of reference, appraisal, 56-57, 394-96, 
410, 416, 485-87 
individual for each candidate, 15 
Interview as, 113 
psychiatric organismic, 47 
rating, 113, 128-29, 204, 280-81, 287, 394- 
96, 485-87 
setting up, 464, 481 
French, Dr. John R. P., 323 
Friendliness, at assessment center, 24, 33-34, 
64, 225-26 

Friendship, Oriental, 352, 368 


Frustration, Coat Hanger Test, 348 
Construction Test, 102-105, 111-12 
on emotional stability, 282, 285, 303 
on energy and initiative, 262 
on motivation, 236 
Murder Mystery Test, 190, 196 
physical ability and, 295 
Post-Stress Interview, 139 
Projective Questionnaire, 91 
Sentence Completion Test, 72 
testing, 34, 93, 225, 330, 395 
W Station, 324 

General Impression procedure, 379, 381 
Get Job Done motive, 242-44, 248-49, 260 
Graphic ability, 31, 122, 128 
Grievances, returnee, 401 
Group Practices Battery, 378-81 
Groups, Ceylon testing, 351, 358, 388 
cooperation and interaction, 222-23, 227- 
28 

discussion, 322, 327-28, 336, 338, 345, 351, 
358, 367-68, 388 
India, 367-68 
Kunming, 378 

procedures, 23, 70, 96, 129, 199 
Propaganda Leaflet Test, 346-47 
W Station, 322, 325, 327-28 
WS Station, 336, 338, 345 

Habits, and assessment, 346, 350, 352, 357, 
359 

drinking {see Alcoholism; Drinking Habits) 
work {see Work) 

Halo effect, on appraisal, 41 1 
leadership, 303 
staff, 216, 512, 514 
Health, on emotional stability, 290 
Far East, 366, 372. 374 
Interview, 78-79, 89, 114, 117 
mental, 32, 47, 290-91, 467, 477-78 {See 
also Neuropsychiatric symptoms; Psycho- 
somatic symptoms) 

on motivation, 242, 246, 250, 253, asSw., 
260 

on performance, 20, 209, 270, 454, 477-78 
Personal History Form, 83 
Health Questionnaire, 70, 75-80, 82, 114 
History, past, appraisal, 400, 402 
on assessment, 53-55, 70, 83, 21 1, 282, 
286-87, 317-18, 322, 468, 510 
on attitudes, 72, 74 
Far East, 351, 357-58, 3S1, 379, 383 
Interview, 115-117, 119 
medical, 78 

on motivation, 237, 252, 258 
secret, 21, 222 



Index 


History — Continued 
social relations in, 297, 229 
Sociomctric Questionnaire, 183 
stail’Sj 474 

work, II, 17, 31, ri6, 273, 288-89, 445 
Hsian, assessment in, 353-55> 386-90 
schedule, 387-88 

l.Q. Tests, 264-66, 273 
Ideolog-y, on motivation, 244-46, 255, 257-58, 
261 

on personality, 467 {See also Religion) 
Imagination, appraisal of, 398 
assessment of, 40, 71, 266, 334, 459 
Immigrants {see Foreigners) 

Improvisations, for assessment, 35, 168-77, 
181, 206-208, 228-29, 293, 299, 384 
Incomes, assessee, 500-501 
India, assessment in, 350, 353-55, 364-72 
recruits, 361 
schedule, 355, 366 
staff shortage, 365, 368 
Individual Practices Test, 385 
Individual Project Test, 366-67, 370 
Indo-Chinese recruits, 356 
Indonesian recruits, 361-62 
Induction centers, 291 

Inferences, ability to make, 1 14, 189, 231, 267, 
270, 369 

observation and reporting, 91-92, 144, 159, 
3ii» 3i4> 337 

for personality assessment, 50, 54 
Infiltration Course, 370-71 
Informants, appraisal, 399, 403-409, 422, 435 
appraisal ratings, 408-13, 421 
intelligence of, 404-405, 407 
reliability of, 404-406, 416-17, 420, 435 
reticence of, 413 

Information, via acquaintances, 36 
Cable Report, 340, 342 
candidates* on assessment process, 20-21 
collection of, 10, 31, 132-33, 189, 197, 216, 
310-12, 47^ 

inadequate on overseas jobs, 12-14, 22, 29- 

30, 430 

Kunming, 37^-77 
Propaganda Leaflet Test, 346 
Recruiting Interview Test, 337 
SIX-2 Test, 143 
Ingenuity, 270, 336, 347 
Inhibitions, 489-90 
Initiative {see Energy and Initiative) 

Inner States, 72, 89, 115, 282 
Institute of Educational Research Intelligence 
Scale, CAV'D, 82 

Instruction, OSS schools, 145, 159* 333 
Instructors, Far East, 355-57* 360-61, 365-66 
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Integrity, errors, 439, 442, 444, 446-48 
scores, 214, 217, 459 
SlX-2 Test, 232 

Intelligence, afferent and efferent, 314 
conception of, 264-67 
conceptual, 272 
on creadveness, 266 
objects of, 272-73 
scholastic, 224, 265-66 
social, 214, 224, 272, 274 

Intelligence, effective, appraisal, 400, 404, 408, 
438, 430-32. 438-3‘:»^ 443* 445-47 
assessment of, 21, 30, 4J, 47, 70, 456, 492 
Assigned Leadership Tests, 149, 151, 153, 
155. 158-59* 273, 518 
Brook Test, 96-97, 273-74, 434. 518 
Ceylon, 358-60, 363-64 
Debate Test, 178-79, 272-73, 279-80, 434, 
518 

Discussion Test, 129-31, 272-73, 276-77, 
279-80, 434, 518 
emotional stability on, 274, 294 
energy and inidative on, 263-64, 274, 276- 
77 

executives', 269 
factor analysis, 513-16 
Hsian test, 367, 389 
India, 367-69 
informant, 404-405, 407 
Interview, 273, 434, 518 
Judgment of Others Test, 272, 279-80, 
434. 518 

Kunming, 375-76, 378, 381 
on leadership, 149, 151, 153, I55> 158-59. 
306-308 

Matrix Test {see Matrix Test) 

Mechanical Comprehension Test, 127, 518 
on memory, 266, 270, 274 
on motivation, 238, 253-37, 273 
Nonverbal Battery, 434, 518 
observing and reporting, 268, 271-72, 274, 

314 

Otis Test, 71, 82, 232-33, 273, 276, 279- 
80, 308, 518 

on physical ability, 272, 277 
Post-Stress Interview, 141 
propaganda skills, 268-69, 273 
quality of, 13, 225, 248-49, 253-56 
rating, 314-15, 230, 265-81, 430-33, 434 
SIX-3 Test, 273, 279, 518 
staff’s, 56, I2I. 268, 473 
Stress Interview, 133, 434 
and other variables, 5tr. 5^8 
Vocabulary Test, 273, 276, 279, 434 
W Station, 327. 332, 430-32 
Wail Test, 10 1 
WS Station, $37. 343-47 
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Index 


Intelligence work, agents, lo, 14, 142, 268- 
^9f 3l4i 389 

assessing ability for, 95«„ 132-33, 137, 
160-61, 197, 216, 273, 394, 397, 433- 
35 , 504, 513 
Far East, 372-74 

material evaluation and abstraction, lo, 
i 3 »- 33 i M 2 - 44 > ^ 97 , 216, 310, 314, 

340) 337) 342, 346, 376-77 
Interpretations candidates’ own, 115, 270 
of Projective Questionnaire, 90 
Sentence Completion Test, 74 
stall ability in making, 206, 262, 264, 267- 
68, 463, 476 

Interpreters, role in assessment, 350, 354-57, 
362, 365-69, 375) 387 
Interrogation Test, 310, 312 

(Escaped Prisoner), 132-33, 161-63, 198- 
99 

Interview, appraisal, 398-99, 415, 432, 444 
Ceylon, 357, 360-61 
Chinese officers, 383, 385-86 
and emotional stability, 116-19, 285-86, 
287-90, 294, 519 
environment for, 23 
F Area, 349, 402, 415 
and health problems, 78-79, 89, 114, 117 
Hsian test, 387-89 
India, 366 

and intelligence, 273, 434, 518 
Kunming, 375, 379-80 
for leadership, 301-302, 304-306, 308, 521 
methods, 26, 116-17 
motivation, 118, 233, 259 
observing and reporting, 434, 523 
overseas, 355, 398-99 
Personal History Form use in, 82-83, 89 
physical ability, 522 
Projective Questionnaire, 90-91, J14 
propaganda skills, 524 
S staff, 204, 206, 2o8-I2 
on security, 522 
V. situations, 216, 229 
social relations, 34, 296-97, 520 
use of, 34, 38, 51, 53-54, 66, 70, 75, 113-22, 
139 ) 147 ) 217, 226, 455, 470, 511 
W’ Station, 320, 321-23, 327, 331-32 
Work Conditions Survey, 80 
WS Station, 343—46 
Interviewer, ability of, 117 
attitudes of, 408 
errors of, 439, 443 
Far East, 366-67, 379-81 
functions, 66 , 70, 78-79, 82, gsn., 114, 
i88» 232, 278-80, 287-88, 290-91, 297, 
299. 305-306, 474, 510 


Interviewer — Continued 

and motivation, 233, 237-38, 243, 2„ 
236-59 " 5 =' 

overwork, 219-20 
own candidate affiliation, 218, 290 
Post-Stress Test, 139-42 
returnee appraisal, 403-406 
S staff, 207-209, 211-12 
Sentence Completion Test, 75 
V. test results, 118-19 
W Station, 322-23, 332 
WS Station, 344-45 
Interviewing, of appraisers, 484 
branch officer, 61 
future, 464, 476 
Investigators, stall appraisal, 399 

Japanese, Army, 389-90 
influence on Koreans, 350 
motivation v., 245, 352 
Javanese recruits, 351, 356 
Job descriptions, inadequate, 9, 11-14, 19, 25, 
32, 283-84, 296, 336, 393-94, 429, 438’ 

449. 457. 459. 492 

prior to assessment, 28-29, 475-85 
recruiting officer, 59 
Job fitness, appraisal,. 419-20, 422-28 
assessing, 9, 29, 31, 180, 197, 212-13, 217, 
403-404, 428-30, 435-39) 446, 450-51, 
453 - 54 ) 457 ) 462 

rating, ig, 395-97, 418-20, 423-28, 435, 
44I) 477 , 479 ) 484-86 
in U.S., 60-61 
Jobs, army, 246 

assessed for v. theater assigned, 18-20, 30 
candidate knowledge of, 61-62 
criteria for, 115, 207, 397, 407-408 
F Area, 349, 399-400 
Far East placement, 355, 415-16, 424 
heterogeneity, 14-20, 30-31, 52, 80 
motivation for, 22-23, 52, 214, 235-36, 
240-48, 259, 288-89, 502 
personality variables required for each, 29- 
32, 129, 264-65, 282 
personnel selection for, 464-66 
population sample for, 419 
recruiting for, 59-60 
specific tests for specific, 433-35 
theater headquarters planned, 14 
W Station, 317-18, 331-32, 504 
Joint Chiefs of Staff, 59 
Judgment, appraisal of, 400, 414, 416, 435, 
482 

candidates ability for, 30, 118, 139, 181-82, 
188, 221, 223, 270, 329, 351-52, 385, 424 
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[ydgment — Continued 
candidates on assessment, 24 
candidates v. staff, 298-99, 302 
errors of, 393 , 458 - 59 , 49 ^ 
influences on, 478 
informants’, 407-409, 420, 422 
interviewer’s, 252, 294, 344“45 
Killing the Mayor Test, 156-57, ^59 
laymen, 474 
rating, 3 ^ 

reliability of, 16, 40, 52, 481 
staff’s, 14, 16-17, 3ti I 74 » 203, 216, 287- 
88, 208-99, 30a. 393 . 397 . 4o8, 43 i 
staff conference, 55 ” 56 . 473 
subjective, 39 " 4 i, 5 i, 55 
Judgment of Others Test, i8i, 187-89, 272, 
279-80, 298, 43^9 434, 5t8 


Leadership — Continued 
intelligence on, 267-68, 270-71, 273-76 
judging, 23, 31, 214-13, 301-309, 479, 

483 

Kunming, 375, 378, 380-81 
on motivation, 238, 306-307 
Obstacle Course, 305 
Ods Test, 308 
OWI Test, 124 
physical ability on, 305-307 
Propaganda Skills, 306-307 
Recruiting Interview, 303 
social relations, 301 

Sociometric Questionnaire, 1 85-86, 304-305 
Vocabulary Test, 308 
W Station, 326-27, 328, 332 
Wall Test, loi 
WS Test, 337, 345-47 


Kandy, 35 o> 355 

Karen recruits, 35 i- 53 » 356 > 367 » 37 ^^ 

Killing the Mayor Test, i 55“59 
Korea, intelligence work in, 389-90 
recruits from, 350, 386-90 
Kunming, assessment at, 350, 35 ^- 53 > 355 . 
372-82 


Learning, ability, 118, 149, 35 i> 359 i 477 
theory of, 471 

Leniency error, 218, 404, 411, 416, 418, 445- 
46 

Malayan recruits, 35 o- 5 i> 356 . 361 
Manchuria Test, 128-29, 132, 206, 345* 5 M 
Manpower, 235, 373, 4^8 
Map Memory Test, 124-47, 310, 313, 336 


Language, on assessment, ii, 17-18, 71, 82, 
127-28, 209, 350, 356, 361-62, 368, 
388, 446 
foreign, 362 
on performance, 416 
on personality, 498 
on scores, 214, 232, 273, 507-508 
Laymen, personality sketches for, 47 . 54 » 
rating by, 395 » 4 ^^ 

on staff, 474 . « 

Leadership, appraisal, 400, 404-405, 40b, 410, 

430-31 

Assigned Leadership Testa, 147-59 
Brook Test, 96^ 98 - 99 , 301, 304 , 306-309. 

521 ^ . 

Ceylon testing, 351-52, 358 - 59 , 30 i 
Chinese officers, 385 
Committee Report Test, 338 
Construction Test, 102— 104, 111-12, 520-21 
correlations with variables, 306-309, 511 
Debate Test, 178-79, 262-63, 301, 303 - 305 , 
307-309, 521 

Discussion Test, 301, 303-304, 307-309, 


Mapping, 359 - 6 o 

Matrbc Test, 71, 273, 279-80, 321, 358, 432 , 

434, 518 

Maturity, emotional, appraisal, 400, 439, 443 
assessment 33, 117, 286, 289, 513 
Mechanical aptitude, 13, i6j 23, 42, 47, 268, 
270-72, 279, 324-25, 359, 369-70, 402, 
432, 476 

Brook Test, 97 

Mechanical Comprehension Test (Bennett), 
38, 42, 127-28, 273, 276. 278-80, 336, 
432, 518 

Medical . Branch, psychoneufotics, 432, 45 i» 
460 

testing, 63, 75, 209, 270, 336, 373 
Medical training, for staff, 47 i» 474 
Mediterranean Theater of Operations, 398, 
424 

•' Memory, and intelligence, 166, 27°. *74 
Names and Identifications Test, 159-00 
tor observing and reporting, 311. 3 ^ 4 . 434 , 
5*3 

«!rina^^6. 31 , 124 -* 7 , *31, 336. 369. 379 


521 

emotional stability on, 294, 306-307 
energy and initiative on, I 49 , ^ 5 i,' ^ 53 - 55 , 
263, 306-307 

F Area, 402 ^ 

factor analysis, 

Improvisations, 169-70 
India, 367 


Battery Test, 434, 523 

Eor Design Test, 336, 358 , 369 

, Ak'.iiMff Intelliffcncc; 


349, 4 ®^> 4^6 

Military personnel, * 35 , * 47 , * 3 , 4*9 
Mined Road Test, 148-50, *53 
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Index 


Modified Thematic Apperception Test, 383- 
84 

Mood, at assessment, 20, 52, 68, 171, 183 
Morale, at assessment, 24, 93, loi, 160, 197 
enemy, 10 

overseas staff appraisal, 398, 411 

9 f I 3 > 30, 1 18, 236-37, 258, 286, 295, 
352, 476, 478, 513 
Morale Operations Course, 36 
Motivation for Assignment, analysis of, 233- 
62 

appraisal, 400, 404, 418, 430-31 
assessment of, 30, 40, 52-53, 68-69, 256- 
5 Si 33 t- 32 , 345 - 4 ^. 454 , 456 . 477, 486, 
492 

correlations, 238, 248-56, 511 
debate— Discussion Tests, 333, 237 
emotional stability, 238, 248-52, 254-57, 
261, 282-84, 286, 289 
Energy and Initiative, 233, 262-64, 237-38, 

249, 258 ’ 

errors, 439, 442-44, 446-48 
evaluation of, 248-64 

for Far East, 351-52, 368, 378-81, 387, 

389-90 

Improvisation, 171 

Intelligence on, 238, 253-57, 272 

Interview, n8, 233, 259 

Killing the Mayor Test, 159 

on leadership, 238, 306-307 

Manchuria Test, 128 

Obstacle Course, 164, 166 

on overseas performance, 259-62, 422 

Personal History Form, 83 

and physical ability, 238 

Past-Stress Test, i38-39;i.42, 233. 237 

propaganda skills, 238 

scores, 214-13, ,,35^ 512-137-515 

Sentence Completion Test, 72 \ 

Movm Observation Test, i6o-6r, 310, 

Murder Mystery Test, gm., 1S9-97, 199-200'., 

Name Cover, name) 
Names4andJdentification Test, ,39-5o. 311. 

^yTvT’ ^50. 402, 408 

Navy. U.S., recruitment from, 59 

Navy Department, U.S., rating, 4,4 

Nazism, motivation, 242, 244-43, 233 

Needs, personality, 36, 46, 284. 287 336 

Neuropsyohiatric symptoms, assesses eSna- 

«un cause, S and W Stations, 429, 431- 


Neuropsychiatric symptoms— Co«//n(«d 

assessing, 30, 33, 51, ^73, ,33-86, 288-8, 
73 ^ 47 ^’ 

breakdowns, 13, 286, 290-91, 357 
(See also Psychosomatic symptom’s) ' ^ 
Non-Language Tests, 357, 377, 387 
Non-Vc^rbal Battery, 71, 379-80, 43J, ,,3^^ 

Object, of intelligence, 272—73 
personality of, 37, 44-45 
Object Observation Test, 366, 369 
Observation, casual informal, 33, 38, 67, 3. 
168, 286-88, 293 ’ 

Interview on, iii-ia, 118-19 
by overseas staff, 355, 350-61, 366, 371 
379 > 387 ' 

S staff, 196, 203-204, 206-207, 213, 21Q 
■2-21, 223, 226-27, 286-88, 293 
scientific method of, 463 
short time of, 429, 510 
staff, 32, 34, 37, 52-53, 150, 152, ,6,|^ ,jj 

^27-29, 429. 471. 476 

Staff appraisers, 414 
W staff, 328 

Observation and Memory Battery, 375, 377-80 
Observation Platform Test, 367 
Observing and reporting, assessment of, 16, 
31, 124-27, 214-15, 232, 238, 263, 295, 
306-307, 309-15, 342, 369, 433-35, 510 
Belongings Test, 91-92, 310-11, 313, 338, 
343 - 44 > 434 . 523 

Brief Case Test, 9i»., 189, 310, 313, 336- 

38, 434. 523 

Cable Report, Flashlight, Editorial Tests, 

342-44 

Committee Report Test, 338 
factor analysis, 513, 515-16 
Far East, 358, 360, 375 
intelligence on, 268, 271-72, 274, 314 
interrelations, 231, 314, 5J1 
Interrogation Test, 161 
Movie Observation Test, 160-61 
. Names and Identification Test, 159-60, 
\ 311. 434 i 523 

^^Recruiting Test, 310 
S'iJX-z Test, 311-12, 337, 523 
Terrain Test, 159, 310-11, 313, 434, 533 
Voc-abulary Test, 434 
WS 'Station, 336 

Observiri^g and Reporting Test, 434 
Obstacle (bourse, assessment, 161, 164-67, 181, 

1 97 * 2L\6, 2 1 6, 227, 262-63, 305. 366, 
375 , j 378 -- 8 i , 383-85, 510, 517 
umcers, brancii; administrative Adminis- 
trative ofiiceVs, branch) 
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0 !&cai— Continued 
motivation, 241 

rating of, 22, 63, 217-18, 318, 395, 418 

recruiting, 59-6 1 
service status, 503 
Organization, ability, 31, 40, 464 
Assigned Leadership Tests, 149-50, 152-53 
Debate Test, 179 (See also Leadership) 
Organizations, reputation of, 241, 485 
standards of, 474~75 
Orientals, assessing problems, 351-52 
OSS, administrators (see Administrators) 
appraisal, 414, 462, 482 
assessment for, 3-41 6 , 9 
candidate’s impression of, 20, 62 
motivation for, 233, 235, 245, 250, 504 
Personnel Procurement Branch (PPB), 14, 
17, 59, 6r, 399, 455 
purpose described, lo-ii 
reputation, 242-43^ 249 - 5 ° 
school training, 15, 22, 61, 213, 492, 504 
Security Branch (see Security Branch) 
standards of acceptance, 23, 452, 455 
system v. other systems, 467-68 
Otis Self- Ad ministering Test of Mental Abil- 
ity, yiy 82, 232-331 273, 276, 279-80, 
308, 518 

Overseas, assessment, 350-91 
Stall Appraisal, 398-99* 406-408, 410, 412- 
15, 418, 420-26, 428 
Overvaluation, 442-46 
OWI Test, 122-24, 128, 206, 232, 524 

Paper Form Board, 358 
Parachute Jump Test, 366, 370 
Party Test, 348 

Patriotism, 242, 244, 248-49, 253, 255, 260, 
390 

Perceptual Acuity Test, 375, 378-79 
Performance, appraisal, 19, 22-23, 29, 57, 
398-99, 401, 403, 406-408, 411, 414-16* 
419, 421, 443, 474, 481, 483-84 
assessees v. general norms, 23, 201, 505-509 
basic determinants, 35, 46-47, 5 ^- 54 * 4^3 
candidate discussion of, 93, 228 
consistency of, 38-39 

efficiency, 267, 269-71, 397 “ 98 , 400-401, 
456 

emotional stability on, 221, 282, 285, 292 
Far East, 352, 356, 361, 375, 377 * 387 
and job, 424-26 

long assessment in organizational v/ork, 

491 

motivation and, 248, 259-62 

OSS training schools, 492 

personality variables on, 29-32, 183, 4 ^ 9 - 3 °* 

ACin 


Performance— Con/inwe^ 

prediction of, 203, 392-93, 450 
prognosis, 203-20^, 435-39, 445, 447 
recruiters' ideas of, 59 
S Station, 100, 113-14, 119, 154-55, i59j 
164, 168, 172, 174, 176, 198-200, 207- 
208, 211 

stress on, 138-39, 14^^, 453“55. 486 
tabulation of, 464 
unsuitable candidates v., 9 
Periods A — G, S Station, 231-35, 262-63, 
278, 290-92, 295, 298-300, 301, 305- 
306, 313 

Personal development, 245, 251, 253, 258 
Personal History Form, 38, 66, 69-70, 78, 82- 
91, 114, 117, 141, 288, 319, 336, 383, 
387, 497 

Personality, assessing, 8, 20-23, 5^-53, 218, 
333 * 392, 397 * 429-30, 458-59 
candidates* judgment of, 290, 329-30 
components of, 83, 270-72 
consistency of, 38 

diagnosis of, 169, 203-205, 435-41, 445- 
48, 460, 462, 488-89 

emotional stability, 223, 281, 285, 288-91, 

293-94 

formulations of, 43-53, 464 
influences on, 177, 221, 225, 288-89 
informants’, 408 

interviewer’s knowledge of candidate’s, 70, 
344 

on motivation, 248, 259-61 
organismic or elementalisdc approach, 41 
Oriental, 351, 356, 363-64, 379’82, 384-85 
on performance, 205, 423, 490 
psychologists’ theories on, 26-28 
social elations, 296-97, 299-300 
staiPs own, 205-206, 475 
study of, 462, 466-70 
Tests of, 74-75* 90-91* loo-ioi, 132, 137, 
158, 165, 176, 179, 183, 227-29 
variables (see Variables, personality) 
as a whole, 28, 43-53* 488 
Personality sketch, appraisal, 404 
candidates’ own, 182, 187-88 
Chinese officers, 383, 385 
formulation, 31-32* 47 , 53 " 56 , 461 
S Station, 54, 75 , 20^14, 217-18, 266, 
297, 306, 426-27 
WS Station, 336, 348 
Personnel (see by name division) 

Personnel Procurement Branch (see OSS) 
Persuasion, staff's ability, 56 
testing, 233, 270, 307, 337, 346 
Physical ability, appraisal, 400 
assessing, 20, 23, 31, 52* 455 
Athletic Events, 197 
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Physical ability — Continued 
Brook Test, 96, 99, 522 
Ceylon, 353, 339, 363-64 
Chinese officers, 385 
factor analysis, 513-16 
Hsian, 353, 388-89 
India, 353, 371-72 
V. intelligence, 272, 277 
Kunming, 353, 375, 378, 380-81 
Obstacle Course, 164-67 
and other variables, 238, 263, 294, 305-307, 
510-11 

S Station, 121, 209, 214-16, 268, 270, 279 
W Station, 323 
Wall Test, 101 
WS Station, 338-39 

Physical examination, 63, 75, 209, 270, 336, 
373 

Physical Symptoms Inventory, 319 
Pistol Assembly Test, 366, 369, 387 
Placement, candidate, 217, 236, 446 {See also 
Jobs) 

Planning, candidate ability for, 267-68, 270, 

314 

India, 368 

intelligence for, 269-72 
Killing the Mayor Test, 157-59 
WS Station, 337, 347 
Population, ability average, 391 
age, occupation, incomes, 499-501 
appraisal analysis, 417-22 
assessment, 350, 376, 497-509 
motivation, 234 

S Station, 71, 204-205, 247, 278, 281, 309, 
312, 428-30, 435-36, 498, 500, 502-503 
sample size for study, 339, 391, 419-20, 
422, 435-36, m 
types of underestimated, 441-42 
W Station, 428-30, 498, 500, 502-503 
Post-Construction Interview, 112-13, 293 
Post-Improvisation Test, 208 
Post-Stress Interview, 132, 136, 138-42, 206, 
233i 287, 292-93, 347-48, 519, 522 
Postwar plans, 147, 168, 171, 207, 237, 243 
Practical intelligence {see Intelligence, effec- 
tive) 

Practical Judgment Test, 434 
Prediction, appraisal. 57, 400, 414, 423, 450, 
459, 469, 477, 482 
basis for, 28-29, 36, 43, 488 
foreigners, ii 
future, 464 
Interview, 118-19 
organismic v. elementalistic, 41, 51 
performance, 203, 392—93, 450 
reliable, 8, 52, 55 
staffi, 203, 297, 356, 460-61 


Prejudices {see Bias) 

Preparation-for-Tcaching Test, 144-45 
Prestige, Chinese, 353 

c/Iccts of, 172, 174, 395, 442 
motivation, 242, 245-46, 250-51, 254-55 

259. 261 

S staff’s, 220 

Procedures, candidates toward, 20-21. a a 
Ceylon, 357-61 

Chinese officers, 383 
environment for, 23 

evaluation of, ig, 22, 56-57, 393, 407, 423, 
432, 462, 481, 492 

to fit variables, 8, 296-97, 301, 303, 307- 
308, 312-14. 331. 485 
India, 367-72 

intelligence rating, 266, 273-81 
multiform future, 464-65, 473-93 
S Station, 203-204, 216, 219-29, 231, 234 
theories of, 28, 41 

type number, 26, 34-38, 52, 206, 227-29, 
459> 474 

W Station, 322-25, 328, 331 
WS Station, 333-48 

Professional advancement, 242, 249, 253-55, 
257, 260 

Programs {see Schedules) 

Propessive Matrices Test, 233, 319, 336, 387 
Projective Questionnaire, 82, 90-91, 114, 288 
Propaganda Leaflet Test, 345-46, 347 
Propaganda Recognition Test, 338-39 
Propaganda skills, Committee Report Test, 

338 

Debate Test, 180, 524 
Discussion Test, 524 
Judgment of Others Test, 187 
Manchuria Test, 128-29, 524 
and other variables, 238, 263, 268-69, 273, 
295, 306-307, 5n 
OWI Test, 122-24, 524 
rating, 510, 512-16 
Sociometric Questionnaire, 185 
testing, 16, 31, 82, 144, 214-15, 232-33, 
504 

writing, 209, 216, 278, 304, 397, 428 
Psychiatrists {see Psychologists and psychia- 
trists) 

Psychiatry {see Psychology and psychiatry) 
Psychoanalysts, 466-67, 471, 489 
Psychodramas, 53, 168 

Psychologists and psychiatrists, ability, 41, 

51-52 

dudes, 469-73 

ideas, 78, 83, 91, 430, 460-61, 481-82 
number of, 3-4, 6, 25, 3 19, 472 
nvalry, 469-73, 489 
theories of, 26-28, 39-40, 46, 464 
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Psychologists and psychiatrists— 
iraining of, 48 - 49 i 54 , 204, 462, 469 “ 73 , 

488 

Psychology and psychintry. abnormal, 470 
development of, 38, 5 < 5 , 465-71 
financial backing for, 462-64, 466 
Psychometric Tests, 336, 361, 366, 369 
Psychoneurotic symptoms (see Ncuropsychi- 
^ attic symptoms} Psychosomatic symptoms) 
Psychopathy, 447 

Psycho-Somatic Experience Plank, 319 
Psycho-Somatic Inventory, Mcparland-Seitz, 

38, 79-80. 82 

Psychosomatic symptoms, 70, 78, 290-91, 402, 

409, 447, 478, 489 

Purpose, Interview, 115 
Killing the Mayor Test, 157 
in personality, 46—47, 69, 72, 74 

Qualifications, for assignment, 20, 212, 241, 

458, 476 

candidates’ varied, 15-16, 20, 30-32 
Questionnaires, testing, 34 , 38, yo (See also 
by name) 

Race, on assessment, 69, 83, i8n, 328, 350, 

361, 372 

stafl's, 475 

Railroad Bridge Test, 336-37 
Rank, and appraisal, 395, 408, 418 
lack of at assessment, 21-22, 63, 183, 317- 

18, 329 

Rapid Projection Test, 334 
Rating Board, S staff use of, 213-14, 234 
Ratings, appraisal, 29, 381, 383, 386, 396, 
406-12, 416-31, 483-841 487, 491 
candidate v. staff, 299, 301-302, 304, 309 
Ceylon, 358, 361-64 
Chinese makers of, 381, 383, 386 
correlations, 22, 516-24 
distribution curve, 308-309, 409-11, 416, 
426, 486-87 

effective intelligence, 265-81 
clcmentalistic method, 39, 41 
of emotional stability, 290-95 
energy and initiative, 262-63 
F Area, 349, 415-16 
final, 95»., 113, 119, 435 » 5 i 6 
formulations, 32, 43, 52-53, 55, 464 
health, 79 
Hsian, 389-90 
Interview on, 113* 119 
Kunming, 376, 379-82 
leadership, 301-306, 309 
motivation distribution, 233-37, 248, 256- 
59 


Ratings — Continued 

observing and reporting, 92, 127, 161, 312- 
13 » 342 

OSS instructor, 333 

over-all, 217, 395^ 412, 415-16, 419-20, 

426, 433 ‘' 34 » 478, 5I0--1I, 513, 515 
overseas service time on, 418 
overseas staff, 398-99 

for personality variables, 230-31, 479-81, 

488 

recording, 490-91 

reliability, 22-23, 188, 392-97, 421-22, 446 
returnee, 404-406 

S Station, 203-29, 273-74, 308-309, 419- 
20, 423, 425-31, 433-34, 486, 505, 512 
social relations, 297-301, 478 
test, 74-75) 9^, 122-24, 127-28, 130-31, 

144, 159, 161, 171, 178, 185-88, 197, 
506-507 

under and over, 439-47, 458-59 
varying standards, 293-94, 408-13 
W Station, 332, 423, 435-31* 433-34 
WS Station, 342-43 
{See also Scores; Scales) 

Ravine Test, 378 
Reading Test, 375-76, 391 
Reassignment Area Appraisal, 398, 401-403, 
407-408, 41 1, 415-16, 418, 420-21, 423- 
26, 435 

Reassignment center, 401, 415 
Recommendations, checking, 392 
F Area, 349 

faulty, 433, 442, 444 * 446 
for future assessment, 464, 473-93 
general bases, 19, 55, 60-61, i88, 299-300, 
396, 457 i 461-62, 510 
Interview on, 114, 117 
and job, 219, 427 ’ 

Kunming, 376 
and personality, 43, 54 * 488 
S staff, 213, 216-17* 221, 426 
W Stadon, 33 ^ 

Recording aids, 37 
Recreation, for testing, 121, 367 
Recruiting ability, 16, 31, 269-71, 337 * 455 
Interview, 35 . 232, 303. 3 io. 336-37 
Rccruidng, of candidates, 58-61, 236, 316 
Far East, 350-51* 354 * 356 , 37 ^- 73 * 39 °- 

individual, 60 ^ 
standards conflict, 365, 372 
Rejectees, 15* 60, 363-64* 396 - 97 * 46 i 
Far East, 354 * 363-65* 372 * 39 ® 

Rejection, by associates, 171. 185-80 
Religion, on assessment, 69, 115* ^ 4 ^* 35 , 

357 

staff’s, 474 (See also Ideology) 
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Reporting {see Observing and reporting) 
Reports, appraisal, 22, 424-25, 435, 436, 438- 
A7 

Far East, 361, 376, S 79 -^h 3 ^ 5 * 

OSS personnel, 400-401 
stafi S, 22, 55, 188, 212-13, 2 i6-i7i 220, 
231, 306. 435. 438--47 
type changes, 19 
W Station, 332 
WS Station, 348 

Resentment, v. assessment, 64, 467 
and emotional stability, 289 
returnee, 415 

S Station, loi, 116, lu, 160, 201-202, 
225-27, 292 

stall dissipation of, 225, 227 
Stress Test, 225 
W Station, 330 
WS Station, 335, 344 

Resourcefulness, assessing, 30, 47, 266, 268, 
270, 398 

Assigned Leadership, 155-56, 159 
Brook Test, 97 
Debate Test, 178 
Discussion Test, 129 
Interrogation Test, 198 
Obstacle Course, 164 
Post-Stress Test, 14 1 
Railroad Bridge Test, 336 
Stress Interview, 134, 137 
Responsibility, 13, 31, 114 
Assigned Leadership Tests, 149, 15 1, 157- 
59 

Returnee Appraisal method, 398, 401, 403- 
408, 411-13, 416-17, 420-17, 431, 435- 
36, 438 

Returnees, F Area reallocation, 349, 425 
Review Compass Course, 360 
Role, at assessment, 22, 37, 170-73, 175 
composite, 11-12, 265, 483 
effect on personality, 471 
pre-analysis need, 29, 393“94, 476-79 
qualities for, 19, 36, 265, 268 
staff^s, 56 

Rorschach Test, 38, 75, 209, 313, 474 
Running Time Course, Army, 166-67 

S Station, assessment at, 203-315 
assessment procedures, 26, 58-202 
atmosphere, 24, 33-34, 64, 225 
candidate attitude toward, 34 
establishment of, 5 
expectation of, 19 
formulations, 203-229 
location of, 23-24 
own cover story, 64 
personality variables analysis, 230-315 


S Station— 

population of, 332. 419-20, 428-30, 497, 
98, 500, 502-504, 507, 510 

ratings, 22, 203-229, 395, 408, 423, 425. 
30, 433 - 34 * 510 

sample appraisal analysis, 435-48 
schedule, 24-25, 58-202, 204, 492 
arrival at, 63-67 
First Evening, 67-93 
First Day, 93-146 
Second Day, 147-81 
Third Day, 181-200 
Last Morning, 300-202 
security of, 21, 65, 201 
seven Periods of, A — G, 231-33 
as a standardized society, 221-25 
Sabotage work, 950., 268-69, 372, 397 
St. Denis Test, 304 

Scales, rating appraisal, 29, 399, 404, 406, 
409-10, 485-87 
defined, 32-33 
4-point, 32, 205, 480 
handling of, 217, 235-36, 280-81, 479-81, 
484-87 

shifting values, 309 

6-point, 32, 79, 92, 122, 127-28, 144* 159* 
185-86, 188, 204, 214, 312, 399, 406, 
.409-10, 415, 420, 433 - 34 . 480-81* 486, 
505 

3-point, 376, 404, 48*^ (See also Rating) 
Schedule, inadequacies of, 15 
length of, 128, 428-30, 465, 
number of skills for, n 
planning, 24, 26, 33, 219-20 
pressures on, 53 
stations {see by name) 

Scholarship, 265-66 
Scores, averaging, 216-17 
distribution of, 278 
for evaluations, 203 
individual, 205 

weighting, 216 {See also Rating) 
Screening, effect of condidons, 457-58 
efficiency of, 425 
errors, 461 
length of, 430 
ncuropsychiatric, 432-33 
process of, /), 9, 23-25, 29, 59, 61, 

396, 491 
on rating, 411 
Search Test, 304, 377, 379 
Security, components of, 31 
Construction Test, iii 
Cover story for, 21-22, 62, 64-65, 226 
emotional stability, 293, 295, 300 
factor analysis, 512-13, 515-16 
Far East, 354, 365 
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Security — Co niin ued 
Interview, ii8 

Judgment of Others Test, i88 
on motivation, 238, 250-51, 255, 261 
organizational, 4*42 

and other variables, 263, 3 o 6 “ 307 p 5 ” 
Post-Stress Interview, 138-42, 522 
Projective Questionnaire, 91 
on recruitment, 59 
S Station, 21, 65, 201 
scores, 2i4-i5» 230, 510 
Stress Interview, i 35 - 37 » 522 
W Station, 21, 317, 319-20, 330-31 
WS Station, 337 ) 348 
Security Branch, OSS, 61-62, 115, 455 
Selection, elcmentalistic principles v. organ- 
istnic, 3 

o£ recruitment, 236 

Self-confidence, assessing, 22, 47, 69, 165, 
174) 287, 293, 306 
failures on, 456 

on motivation, 250-51, 253 ) 257 
test discussion for, 93-94 


Situation Tests — Continued 
verbal, 262-63 

verisimilitude, 38, in, 464, 471 
W Station, 316-17, 321-31 
WS Station, 334-48 

Situations, wartime, 11-12, 259, 261-62, 285- 
86. 423, 457 

SIX-2 Test, 132, 142 - 44 ) 232, 273, 279, 311- 
12, 339. 518, 523 

Skills, on motivation, 242-43, 249, 254-55 
physical, 271, 295, 307 
social, 169, 447-48 

special, lo-ii, 16-17, 23, 31, 4i» 64, 164, 
166, 183, 209, 216, 227, 283, 327-28, 
357 ) 427. 439 ) 45I) 455-56, 459 
staff's, 471, 473 
technical, 29-30, 473 

tests of, 28, 282, 505, 509 {See also Abil- 
ities) * 

Snafu tolerance, 13, 30, 33 , 111-12, 291, 457 
Social relations, appraisal, 398, 400, 404, 408, 
430-31) 439 ) 445-48, 456 
Assigned Leadership Tests, 149, 151, 159 ) 


Self-respect, 250-51, 253, 257 58 , 261 
Sentence Completion Test, 38, 7 i- 75 > 82, 114, 
288, 334 ) 383) 387 
Sentry Test, 150-51 

Series Completion Test, 233, 336, 357, 377 ) 

384 

Sex, assessment, 497-98 

population sample distribution, 419 
of staff, 473-74 i^ee also Women) 

Sign Reading Test, 376, 379-81 

Situation Tests, assimilation of, 221, 267-73, 

274 , 459 ) 477 , 

determination of, 37, 41 - 43 ) 227-29, 407, 

469 

discussion of, 93) 120, 145-40 
emotional stability, 287, 290-92, 294 
Far East, 352, 359 ) 36 i» 365-72, 394 
foreigners in, 18 

group, 3, 34, 74) ^77) 204, 262, 273, 274 
76, 352 ) 359 

Improvisations, 169, 17I) i 75 -o 
Interview, 118-19, 216 
leadcrless group, 3 ) 
for leadership) 301-306, 308 
many, 35“36, 474 

multiform novel, iS-ip) 24, 42 » 474 

observation of, 182, 219 

overlapping, 52 

physical, 263, 271 

problems of, 227-29 

radng of, 205, 214, 511-12 



297, 520-21 

Brook Test, 96-98, 232, 297, 520 
Construction Test, 35 , 102, no, 297-98, 
520-21 

Debate Test, 178, 297, 299, 520 
Discussion Test, 129, 131-32, 297, 5 ao 

early, 467 « 0 

emotional stability, 284, 286, 289, 294 
energy and initiative, 263 
factor analysis, 512-13, 515-16 
Far East, 351, 358-61, 367-68, 378, 380-81 
, importance of, 23, 30, 42, 53 i 476, 49 ^ 
Improvisations, 35, 299 
intelligence on, 273-74 
on job, 478 

Judgment of Others Test, 187, 298 
on leadership, 306-309 
length of, 429, 458-59 
on motivation, 238, 252-58, 261 
and other variables, 301, 5 iii 520 
Personal History Form, 83 
Recruiting Test, 35 

S Station, 121, 211, 213-16, 221, 224-25, 
230-31, 295-301, 430-31 
Sentence Completion Test, 72 
Sociomecric Questionnaire, 34 j 187 
staff's, 56, 220 
'varied, 483 

W Station, 332 

Wall Test, loi 
W'S Station, 337 - 38 * 343-47 
Sociometric appraisal, 424, 484 
Sociometric Questionnaire, 34 i 
298-99, 304-3051 329-30, 3 5 



Index 


540 

Sociometric Questionnaire — Contiimcti 
Far East, 355, 366 
South East Asia Command (SEAC), 3541 37^ 
Specialization, American, 381 
Staff, ability of, 56, 74, izi, lao, 43 ' 3 > 474 
agreement decisions, 26-Z7, 55 - 5 ^» 437 
candidate anonymity on, 21-3.3 
environment on, 24, 33“34 
F Area, appraisal, 349, 401-403 
Far East, 351, 354 - 55 » 3 ^ 5 > 3^8, 379 
informal candidate contacts (see Contacts) 
interviewers (see Interviewer) 
job heterogeneity, 19, 30 
job ignorance, ii“i 4 > 2.9, 29^1 4 ^ 3 > 4 ^ 9 * 
438, 449 » 459 i 492 

judgment, 14, 16-17, 431, 435 i 44 ^ 43 

by name, 4-6, 30, 373 . Introduction 

no military experience, 29 

at OSS school, 14 

problems of, 23 

ratings, 9, 53* 486, 491, 512 

S Station, candidate interrelations, 197 “ 98 ) 

'll 8, 224-27 
clothing, 63 
personality of, 205-206 
teams, 204, 206-209, 2x1 - 14 » 119-20, 
232, 379 

test discussion, 93-94. i4'i-40 

value shifts, 309 
work of, 26-27, 203-21 
written notes, 178 
schedule size, 53, 465 
situational control, 37, 227-29 
size of, 23, 95»„ 319-20, 230, 349, 473-75 
technical skills, 30, 455 
theory disagreements, 36, 47-48) 446, 488 
W Station, 328 
WS Station, 348 
Statisticians, clinical, 474 
Status, and appraisal, 408 

on motivation, 250-51, 253-55, ^57 
on personality, 471 
secret, 21, 62-63 

socioeconomic, 83, 115, 117, 183, 318, 329, 

503 

staff’s, 56, 473-74 
Stress, Construction Test, ni-12 
effects of, 447, 45 1) 4^1 
environment on, 24 
and failures, 452 - 55 . 459 
intelligence under, 40 
in situations, 42, 93, 396, 402, 428-29 
staff ignorance ot, 283 
Stress Interview, 131-4^1 I 45 " 4 ^. 

225, 287, 292, 347-48, 434, 519. 522 
Student Information Sheet, ii, 14, 62, 64, 74, 
33 ^ 

Supplies, on OSS, 356, 373 


Tamil recruits, 361, 363 
Teaching ability, 16, 31, 132, I 44 “ 45 » 268, 
270-71, 455. 476 
Teaching Tests, 159, 209 
Techniques, appraisal, faults, 406-16, 423 
evaluation of, 52, 56-57. 393 . 458 - 59 . 

469, 49 ^ 
number of, 474 

projective, 7i-72» 74. 78 , iM> 168, 464 
ways of varying, 36-38 
Tension, from assignment delay, 6t 
via cover story, 62 
Improvisations, 174 
Interview, 116 
Murder Mystery Test, 200 
S program, 64, 68, 120-21, 145 
Stress Interview, 137 (See also Anxiety, 
Fears) 

Tent Erection Test, 367 

Terrain Test, 94. 159. 189, 310-11. 313, 434, 

523 

Tests, administering principles, 26, 224-25, 470 
appraisal evaluation of, 56-57. 43 1 
Army averages, 336, 505-506 
flsscssecs v. general norm performance, 505- 
509 

candidates toward, 93, 200-201, 225-17 
Chinese officers, 383-85 
correlation between, 486 
discussion after, 145-46 (See also Discus 
sions) 

expense of, 51 
experimental, 199 
Far East, 352, 358, 367-69 
future, 464-65 

handling of, 365, 203-205, 336, 371, 4 ?o*' 

31. 505 

Hsian, 387-90 
India, 366-67 

Intelligence, 38, 40-41, 69, 71, 82, 209, 
253, 264-66, 270, 272, 273-81, 336. 343 . 
345-46, 358, 375 . 390. 505 
job heterogeneity on, 16 
Kunming, 375“79 
length of, 429 

observing and reporting, 310-15 
organismic v. clementalistic, 
paper and pencil, 42, 69, 78. 83. 127-28, 
168, 199, 264, 266, 273. 27S. 278, 280, 
308, 3:2, 314, 375. 383. 43* 
projection, 34, 38, 53 . 90 - 9 i> ^ 38 ) 187 
psychometric, 355, 357-58 
reliability of, 42, 73, 464, 481-82 
role of, 92) 181, 215-16, 223-24 
scholastic aptitude, 509 
scoring, 203, 21 1, 214 
special skill, 16-17, 390, 455 
specific for specific jobs, 433 - 35 i 476 
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Tests — Continued 
standardized, i6, 23, 465, 505 
time for {see Time) 

Thai as assessees, 35 o- 5 i» 361-62 
Theater Commander Appraisal method, 398, 
399-401, 407-408, 412, 414-15, 4 i 7 -i 8 » 
420-21, 423-26 

Thematic Apperception Test (TAT), 38, 75, 

334-36, 383-84 

Time, candidate perspective toward, 72 
clementalistic tests, 5: 
observation, 510 

before securing evaluation of ratings, 22-23, 
405 

shortage for staff, 15, 51 - 53 ) 2 i 9 - 20 » 44 i» 
448 

testing, 71, 83, 100, 124, 127-28, 144, 148, 

155, 158, 174 

Track Meet Test, 366, 371-71 
Training, Far East program, 353, 356 - 57 * 
361-62, 366, 369 
psychologists {see Psychologists) 
stations, 401 
Traits {see Variables) 

Traumata, childhood, 54, 72, 85, ii 5 > ii 7 j 
141, 288-89, 431, 467-68 
Travel, and personality, 498 

Understanding, basis for, 28, 36, i 97 » i® 5 ) 
209, 491 

candidates*, 180, 21 r 
Interview, 114* 117-18 
Undervaluation, 439-41 


W Station, candidate attitude toward, 34 
details of, 316-32 
establishment of, 5 
expectation of, 19 
location of, 23 

population, 332, 419-20, 428-30, 497-98. 

500, 502-503, 506-509 
ratings, 22, 408, 423, 425-30, 433 - 34 , 505- 
509 

schedule, 24-25, 231, 316, 319, 492 
staff, 316, 319, 313, 431 
women, 317, 316-27, 428 
Wall Test, 99-101, 367 
War, on assessment cEficiency, 396 
assessment rating results, 512 
morale {see Morale) 
and motivation, 242-46, 253, 255, 283 
War Department, U.S., ratings, 414 
War Office Selection Board, British Army, 3-4 
Washington, job fitness assessment for, 60-61 
OSS Office, 14 

Weapons Firing Test, 371, 389 
Wechsler-Bellevue Test, 38) 173 , 179 , SH* 

Wcchsler Mental Ability Scale, 358 
West Coast Training Center, 332 
Women, assessing, W, 317, 31^17* 4 i 8 » 443 “ 
44 

on job, 451, 503 
qualities, 31 
recruitment, 60 
wages, 497-981 501 
Word Association Test, 358 
Work, candidate attitude toward, 70 


Variables, correlations {see Correlations) 
Interview on, 113-22, 216 
on jobs, 29-32, 428-29, 476-79, 484* 488- 
9 P 

personality 
analysis, 230-315 

apipraisal, 402, 404-406, 415. 43 P- 3 I> 484 
Station changes in use of, 271-72 
procedures designed specially for, 33—43 
rating of, 3 i- 33 » 104 - 105 » io8j ii 3 ”i 7 ) 
224, 230-31, 33I) 394-96, 41I) 418) 431* 
479-80, 488 {See also by name; Rating) 
tabulation of, 464 

W Station, 317, 319* 321* 316, 331-31 
Verbal facility, staff’s, 56 
use of, 82, 129, 179 . . 

Verbal tests, 232 - 33 , i 77 (See also by name) 
Vocabulary, value of, 518 
Vocabulary Tests, 82, 273, 276, 279, 308, 336, 
431, 434 , ^ 

Atwell-Wclls Wide 

Volunteering, 235. 147 1 ^atlOna 

Votes, stafi use of, 53 , n® 1 


habits, 346, 352, 359 
history {see History, work) 
motivation, 241-41, 145 - 46 , 248-50, 253- 
54 , 157 

overload on staff, 219-20 
types, 263 

Work Conditions Survey, 79-82, 114, 1B8, 
319 

Writing ability, 31, 122, 128, 279, 376 - 77 , 
379 , 476 

WS Station, details, 331-48 
establishment of, 5 
location, 23-24 
organization, 333-34 
schedule, 24-25, 334-48 
First Evening, 334-36 
First Day, 336-43 
Second Day, 343-46 
Third Day, 346-48 




